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Abstract 

Practical  Constraint  Satisfaction  Problems  (CSPs)  such  as  design  of  integrated  circuits  or 
scheduling  generally  entail  large  search  spaces  with  hundreds  or  even  thousands  of  variables, 
each  with  hundreds  or  thousands  of  possible  values.  Often,  only  a  very  tiny  fraction  of  all  these 
possible  assignments  participates  in  a  satisfactory  solution.  This  article  discusses  techniques  that 
aim  at  reducing  the  effective  size  of  the  search  space  to  be  explored  in  order  to  find  a  satisfactory 
solution  by  judiciously  selecting  the  order  in  which  variables  are  instantiated  and  the  sequence  in 
which  possible  values  are  tried  for  each  variable.  In  the  CSP  literature,  these  techniques  are 
commonly  referred  to  as  variable  and  value  ordering  heuristics.  Our  investigation  is  conducted 
in  the  job  shop  scheduling  domain.  We  show  that,  in  contrast  with  problems  studied  earlier  in  the 
CSP  literature,  generic  variable  and  value  heuristics  do  not  perform  well  in  this  domain.  This  is 
attributed  to  the  difficulty  of  these  heuristics  to  properly  account  for  the  tightness  of  constraints 
and/or  the  connectivity  of  the  constraint  graphs  induced  by  job  shop  scheduling  CSPs. 

A  new  probabilistic  framework  is  introduced  that  better  captures  these  key  aspects  of  the  job 
shop  scheduUng  search  space.  Empirical  results  show  that  variable  and  value  ordering  heuristics 
derived  within  this  probabilistic  framework  often  yield  significant  improvements  in  search 
efficiency  and  significant  reductions  in  the  search  time  required  to  obtain  a  satisfactory  solution. 

The  research  reported  in  this  article  was  the  first  one,  along  with  the  work  of  Keng  and  Yun 
[Keng  89],  to  use  the  CSP  problem  solving  paradigm  to  solve  job  shop  scheduling  problems. 
The  suite  of  benchmark  problems  it  introduced  has  been  used  since  then  by  a  number  of  other 
researchers  to  evaluate  alternative  techniques  for  the  job  shop  scheduling  CSP.  The  article 
briefly  reviews  some  of  these  more  recent  efforts  and  shows  that  our  variable  and  value  ordering 
heuristics  remain  quite  competitive. 
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1.  Introduction 

Practical  Constraint  Satisfaction  Problems  (CSPs)  such  as  design  problems  (e.g. 

[Navinchandra  90,  VanHenteryck  92])  or  scheduling  problems  (e.g.  [Fox  87,  Sadeh  91,  Zweben 
94])  generally  entail  large  search  spaces  with  hundreds  or  even  thousands  of  variables,  each  with 
several  hundred  or  thousand  possible  values.  Often,  only  a  very  tiny  fraction  of  all  these  possible 
assignments  participates  in  a  satisfactory  solution,  potentially  requiring  prohibitive  amounts  of 
search  before  one  such  solution  can  be  found.  This  article  discusses  techniques  that  aim  at 
reducing  the  effective  size  of  the  search  space  to  be  explored  by  judiciously  selecting  the  order  in 
which  variables  are  instantiated  and  the  sequence  in  which  possible  values  are  tried  for  each 
variable.  In  the  CSP  literature,  these  techniques  are  commonly  referred  to  as  variable  and  value 
ordering  heuristics.  Our  investigation  is  conducted  in  the  job  shop  scheduling  domain  [Baker 
74,  French  82,  Morton  93]. 

Specifically,  we  study  a  class  of  job  shop  scheduling  problems  in  which  operations  have  to  be 
performed  within  non-relaxable  time  windows  [Sadeh  89a,  Fox  89,  Sadeh  90,  Sadeh  91].  We 
refer  to  this  class  of  problems  as  the  job  shop  Constraint  Satisfaction  Problem  or  job  shop  CSP . 
Examples  of  job  shop  CSPs  include  factory  scheduling  problems,  in  which  some  operations  have 
to  be  performed  within  one  or  several  shifts,  spacecraft  mission  scheduling  problems,  in  which 
time  windows  are  determined  by  astronomical  events  over  which  we  have  no  control,  factory 
rescheduling  problems,  in  which  a  small  set  of  operations  need  to  be  rescheduled  without 
disturbing  the  schedule  of  other  operations,  etc.  When  solving  a  job  shop  CSP,  the  objective  is 
to  find  as  quickly  as  possible  a  feasible  schedule,  namely  a  schedule  where  each  operation  is 
performed  within  one  of  its  legal  time  windows  and  no  resource  is  oversubscribed.  The 
techniques  presented  in  this  paper  have  also  been  adapted  to  solve  Just-In-Time  Job  Shop 
Scheduling  problems,  where  the  objective  is  to  reduce  the  sum  of  tardiness  and  inventory  costs 
of  a  set  of  jobs  to  be  processed  subject  to  relaxable  due  dates  [Sadeh  91,  Sadeh  94]. 

The  job  shop  CSP  can  easily  be  shown  to  be  NP-complete  [Garey  79].  Accordingly,  the 
worst-case  complexity  of  any  procedure  to  solve  this  problem  is  expected  to  be  exponential.  At 
the  time,  we  started  this  study,  CSP  techniques  that  interleave  search  with  consistency  enforcing 
mechanisms  and  variable/value  ordering  heuristics  had  been  reported  to  yield  important 
increases  in  search  efficiency  when  applied  to  a  number  of  different  CSPs  [Haralick  80,  Freuder 
82,  Purdom  83,  Mackworth  85,  Dechter  88,  Nadel  88,  Zabih  88,  Dechter  89a]  [Fox  89].  One  of 
the  objectives  of  our  study  was  to  determine  if  similar  results  could  be  obtained  on  large-scale 
tightly  connected  problems  such  as  those  found  in  the  job  shop  scheduling  domain. 

In  this  article,  we  first  review  generic  variable  and  value  ordering  heuristics  that  have  been 
reported  to  perform  well  on  other  classes  of  CSPs.  We  explain  why  these  heuristics  are  unlikely 
to  perform  as  well  on  large-scale  tightly  connected  CSPs  like  job  shop  scheduling.  In  particular, 
we  show  that  these  heuristics  fail  to  adequately  account  for  the  tightness  of  constraints  and/or  for 
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the  interactions  induced  by  the  high  connectivity  of  the  constraint  graphs  characteristic  of  job 
shop  CSPs*.  The  second  part  of  this  paper  introduces  a  probabilistic  framework,  within  which 
new  variable  and  value  ordering  heuristics  are  defined  that  attempt  to  better  account  for  these 
interactions.  Empirical  results  indicate  that  our  new  heuristics  outperform  both  generic  CSP 
heuristics  as  well  as  more  specialized  heuristics  recently  developed  for  resource-  and  time- 
constrained  CSPs  [Keng  89].  Our  study  suggests  that  a  key  to  defining  these  more  powerful 
heuristics  lies  in  the  ability  of  the  probabilistic  framework  to  provide  estimates  of  the  reliance  of 
a  variable  on  the  availability  of  one  of  its  remaining  values  (e.g.,  in  job  shop  scheduling,  the 
reliance  of  an  operation  on  the  availability  of  a  reservation)  and  measures  of  contention  between 
variables  for  the  allocation  of  incompatible  values  (e.g.,  in  job  shop  scheduling,  measures  of 
resource  contention  between  unscheduled  operations). 

While  our  work  shows  that  the  CSP  problem  solving  paradigm  does  scale  up  to  complex  large- 
scale  domains  such  as  the  job  shop  CSP,  it  also  suggests  that  benchmark  problems  considered  in 
earlier  CSP  studies  are  not  representative  of  this  and  probably  other  classes  of  complex  CSPs. 
We  hope  that  this  research  will  prompt  others  in  the  field  to  revisit  earlier  studies  and  look  for 
more  challenging  problems  on  which  to  evaluate  their  techniques. 

The  balance  of  this  paper  is  organized  as  follows.  Section  2  provides  a  formal  definition  of  the 
job  shop  scheduling  CSP.  Section  3  details  the  backtrack  search  procedure  used  in  our  study. 
Generic  variable  and  value  ordering  heuristics  are  reviewed  in  Sections  4  and  5  respectively. 
Section  6  describes  new  variable  and  value  ordering  heuristics  based  on  a  probabilistic  model  of 
the  search  space.  The  complexity  of  these  heuristics  is  discussed  in  Section  7.  Empirical  results 
comparing  our  new  heuristics  with  other  heuristics  discussed  in  this  paper  are  presented  in 
Section  8.  The  work  reported  in  this  article  was  the  first  one,  along  with  that  of  Keng  and  Yun 
[Keng  89],  to  use  the  CSP  problem  solving  paradigm  to  solve  job  shop  scheduling  problems. 
The  suite  of  benchmark  problems  it  introduced  has  since  then  been  used  by  a  number  of  other 
researchers  to  evaluate  alternative  techniques  for  the  job  shop  scheduling  CSP.  Section  8  briefly 
reviews  some  of  these  more  recent  efforts  and  shows  that  our  variable  and  value  ordering 
heuristics  remain  quite  competitive.  Section  9  provides  a  summary  of  the  paper  and  further 
discusses  the  implications  of  this  study. 

Earlier  variations  of  the  techniques  presented  in  this  paper  are  discussed  in  [Sadeh  88,  Sadeh 
89a,  Sadeh  89b,  Sadeh  89c,  Fox  89,  Sadeh  90,  Sadeh  91]. 


•Constraint  graphs  are  graphical  representations  of  binary  CSPs  (i.e.  CSPs  with  binary  constraints)  in  which  each 
variable  is  represented  by  a  node,  and  binary  constraints  are  represented  by  arcs  between  two  nodes.  Other  graphical 
representations  also  exist  for  non-binary  CSPs. 
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2.  The  Job  Shop  Constraint  Satisfaction  Problem 

The  job  shop  CSP  requires  scheduling  a  set  of  jobs  on  a  set  of  physical 

resources  RES=  [R^,...,R^}.  Each  job  j)  consists  of  a  set  of  operations  0^=  { 0\ , ... ,  }  to  be 

scheduled  according  to  a  process  routing  that  specifies  a  partial  ordering  among  these  operations 
(e.g.  0‘.  BEFORE  Oj).  This  study  assumes  job  shop  CSPs  with  tree-like  process  routings.  A 
tree-like  process  routing  is  one  whose  graph  of  precedence  constraints  forms  a  tree  (see  Figure 
1).  This  is  by  far  the  most  common  situation,  especially  in  factory  scheduling.  Extensions  of  the 
techniques  presented  in  this  paper  to  more  general  types  of  process  routings  will  be  briefly 
discussed  as  well. 


Fig.  1  Examples  of  tree-like  process  routings. 

In  the  job  shop  CSP  studied  in  this  paper,  each  job  has  a  release  date  rd-i  and  a  due  date  (or 
deadline)  dd^  between  which  all  its  operations  have  to  be  performed.  Each  operation  O,-  has  a 
fixed  duration  du\  and  a  start  time  st\  whose  value  has  to  be  selected.  The  domain  of  possible  start 
times  of  each  operation  is  initially  constrained  by  the  release  and  due  dates  of  the  job  to  which 
the  operation  belongs.  If  necessary,  the  model  allows  for  additional  unary  constraints  that  further 
restrict  the  set  of  admissible  start  times  of  each  operation,  thereby  defining  one  or  several  time 
windows  within  which  an  operation  has  to  be  carried  out  (e.g.  a  specific  shift  in  factory 
scheduling).  In  order  to  be  successfully  executed,  each  operation  0\  requires  p\  different 
resources  (e.g.  a  milling  machine,  a  set  of  fixtures  and  a  machinist)  R^j  (1  for  each  of 

which  there  may  be  a  pool  of  physical  resources  from  which  to  choose,  £l\~{r\j^,...,r[  / },  with 

mij 

r\.^  e  RES  (1  <  fc  <  q\p  (e.g.  several  possible  milling  machines). 


More  formally,  the  problem  can  be  defined  as  follows: 


VARIABLES: 
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A  vector  of  variables  (or  aggregate  variable)  is  associated  with  each  operation,  ( 1  <  Z  <  n , 
1  <  j  <  n^),  which  consists  of 

1.  the  operation  start  time,  st\,  and 


2.  its  resource  requirements,  R^,  (l<j<  p|). 

In  our  search  procedure,  each  operation  is  considered  a  single  (aggregate)  variable  whose  start 
time  and  resource  requirements  are  simultaneously  instantiated.  A  tuple  of  instantiations 
associated  with  an  operation,  namely  a  start  time  and  a  set  of  specific  resource  assignments,  is 
referred  to  as  a  reservation  for  that  operation. 

CONSTRAINTS: 

The  non-unary  constraints  of  the  problem  are  of  two  types: 

1.  Precedence  constraints  defined  by  the  process  routings  translate  into  linear 
inequalities  of  the  type:  st\+du\  <  sl^  (i.e.  0|  BEFORE  Oj); 

2.  Capacity  constraints  that  restrict  the  use  of  each  resource  to  only  one  operation  at 

a  time  translate  into  disjunctive  constraints  of  the  form: 

(Vp  R*  Rj^)  V  <  stj  V  stj+duj  <  st].  These  constraints  simply  express 

that,  unless  they  use  different  resources,  two  operations  O*  and  Oj  cannot  overlap. 

Additionally,  there  are  unary  constraints  restricting  the  set  of  possible  values  of  individual 
variables.  These  constraints  include  non-relaxable  due  dates  (or  deadlines)  and  release  dates, 
between  which  all  operations  in  a  job  have  to  be  scheduled.  The  model  actually  allows  for  any 
type  of  unary  constraint  that  further  restricts  the  set  of  possible  start  times  of  an  operation.  As  a 
result,  the  domain  of  possible  start  times  of  an  operation  will  generally  consist  of  one  or  several 
non-contiguous  time  windows  within  which  the  operation  has  to  start.  Time  is  assumed  discrete, 
i.e.  operation  start  times  and  end  times  can  only  take  integer  values.  Finally,  each  resource 
requirement  R\j  has  to  be  selected  from  a  set  of  resource  alternatives,  c  RES. 


OBJECTIVE: 

In  the  job  shop  CSP  studied  in  this  paper,  the  objective  is  to  come  up  with  a  feasible  solution  as 
fast  as  possible.  Notice  that  this  objective  is  different  from  simply  minimizing  the  number  of 
search  states  visited.  It  also  accounts  for  the  time  spent  by  the  system  deciding  which  search  state 
to  explore  next. 

EXAMPLE: 


Figure  2  depicts  a  simple  job  shop  scheduling  problem  with  four  jobs  J—  [/j  ,j2d2>d4) 
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' _  capacity  constraint 

p. 

‘ ^  precedence  constraint 

Fig.  2  A  simple  job  shop  problem  with  4  jobs.  Each  node 
is  labeled  by  the  operation  that  it  represents  and  the 
resource  required  by  this  operation. 

physical  resources  RES=  { ,i?2  ^  this  example,  each  operation  has  a  single  resource 

requirement  with  a  single  possible  value.  Operation  start  times  are  the  only  variables.  For  the 
sake  of  simplicity,  it  is  assumed  that  all  operations  have  the  same  duration,  namely  3  time  units, 
that  all  jobs  are  released  at  time  0  and  have  to  be  completed  by  time  15  (the  minimum  makespan 
of  this  problem^).  None  of  these  simplifying  assumptions  are  required  by  the  techniques  that 
will  be  discussed:  jobs  usually  have  different  release  and  due  dates,  operations  can  have  different 
durations,  several  resource  requirements,  and  several  alternatives  for  each  of  these  requirements. 
However  simple,  this  example  will  often  prove  sufficient  to  contrast  the  merits  of  a  number  of 
heuristics  discussed  in  this  paper.  When  appropriate,  we  will  consider  slight  variations  of  this 
base  problem  to  discuss  issues  that  would  not  be  immediately  visible  otherwise. 

Notice  that,  in  this  problem,  resource  R2  is  the  only  one  to  be  required  by  four  operations  (one 
from  each  job).  Since  all  operations  in  the  example  have  the  same  duration,  resource  R2  is 


^The  makespan  of  a  schedule  is  the  length  of  the  time  interval  that  spans  from  the  earliest  operation  start  time  to 
the  latest  operation  end  time  [Baker  74]. 
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expected  to  be  a  small  bottleneck^. 


^Informally,  a  botdeneck  is  a  resource  or  group  of  resources  whose  utilization  is  expected  to  be  close  to  or  larger 
than  its  available  capacity. 
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3.  The  Search  Procedure 

A  general  paradigm  for  solving  CSPs  relies  on  the  use  of  depth-first  backtrack  search  [Walker 
60,  Golomb  65,  Bitner  75,  Pearl  84].  Variables  or  groups  of  variables  (i.e.  subproblems)  are 
successively  instantiated.  Each  time  a  new  variable  (or  group  of  variables)  is  instantiated,  a  new 
search  state  is  created  that  corresponds  to  a  new,  more  complete,  partial  solution.  This  process 
goes  on  until  either  a  complete  solution  is  obtained  or  until  a  deadend  state  is  reached.  A 
deadend  state  is  one  whose  partial  solution  cannot  be  completed  without  violating  one  or  several 
problem  constraints.  When  in  a  deadend  state,  the  procedure  has  to  undo  one  or  several 
assignments  and  try  alternative  ones,  if  there  are  any  left  (otherwise  the  problem  is  infeasible). 
This  process  of  undoing  earlier  assignments  is  known  as  backtracking.  It  results  in  lower  search 
efficiency,  and,  hence,  is  undesirable. 

In  the  worst  case,  exponential  amounts  of  backtracking  may  be  necessary  to  come  up  with  a 
feasible  solution  (schedule).  In  practice,  the  average  complexity  of  the  procedure  can  be 
improved  by  interleaving  search  with  the  application  of  consistency  enforcing  mechanisms  and 
variable/value  ordering  heuristics: 

•  Consistency  Enforcing  (Checking)  Techniques:  These  techniques  prune  the  search 
space  by  eliminating  local  inconsistencies  that  cannot  participate  in  a  global  solution 
[Mackworth  85].  This  is  done  by  inferring  new  constraints  and  adding  them  to  the 

current  problem  formulation.  If,  during  this  process,  the  domain  of  a  variable 
becomes  empty,  a  deadend  situation  has  been  identified. 

•  Variable/Value  Ordering  Heuristics:  These  heuristics  are  concerned  with  the  order 
in  which  variables  are  instantiated  and  values  assigned  to  each  variable.  As 
discussed  in  the  remainder  of  this  paper,  these  heuristics  can  have  a  great  impact  on 
search  efficiency. 

In  this  study,  we  consider  a  depth-first  search  procedure  that  starts  in  a  state  where  all 
operations  still  have  to  be  scheduled  and  proceeds  by  scheduling  operations  one  by  one  (Figure 
3).  Each  time  an  operation  is  scheduled,  a  new  search  state  is  created  in  which  a  consistency 
enforcing  procedure  updates  the  set  of  possible  reservations  of  unscheduled  operations  to 
account  for  the  latest  assignment.  Next,  the  procedure  determines  which  operation  to  schedule 
(variable  ordering)  and  which  reservation  to  assign  to  that  operation  (value  ordering).  The 
procedure  goes  on,  recursively  calling  itself,  until  either  all  operations  have  been  successfully 
scheduled  or  until  an  inconsistency  (or  deadend)  is  detected.  In  the  latter  case,  it  needs  to  undo 
one  or  several  earlier  decisions  (i.e.  backtrack).  If  there  are  no  decisions  left  to  undo  (i.e.  the 
procedure  is  back  in  the  initial  search  state),  the  problem  is  infeasible  and  the  procedure 
terminates. 

The  results  reported  in  this  study  were  obtained  using  a  simple  chronological  backtracking 
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1.  If  all  operations  have  been  scheduled  then  stop,  else  go  on  to  2; 

2.  Apply  the  consistency  enforcing  procedure; 

3.  If  a  deadend  is  detected  then  backtrack  (i.e.  select  an  alternative 
if  there  is  one  left  and  go  back  to  1,  else  stop  and  report  that 

the  problem  is  infeasible),  else  go  on  to  step  4; 

4.  Select  the  next  operation  to  be  scheduled  (variable  ordering 
heuristic); 

5.  Select  a  promising  reservation  for  that  operation 
(value  ordering  heuristic) 

6.  Create  a  new  search  state  by  adding  the  new  reservation  assignment 
to  the  current  partial  schedule.  Go  back  to  1. 


Fig.  3  Depth-first  backtrack  search  procedure. 

mechanism  that  systematically  goes  back  to  the  most  recently  scheduled  operation  and  tries 
alternative  reservations  for  that  operation.  If  no  alternative  reservation  is  left,  the  procedure  goes 
back  to  the  next  most  recently  scheduled  operation  and  so  on. 

Consistency  enforcing  in  our  procedure  combines  three  types  of  computations: 

1.  Consistency  with  respect  to  precedence  constraints'.  Consistency  with  respect  to 
precedence  constraints  is  maintained  using  a  longest  path  procedure  that 
incrementally  updates,  in  each  search  state,  a  pair  of  earliest/latest  possible  start 
times  for  each  unscheduled  operation.  Essentially,  as  in  PERT/CPM  [Johnson  74], 
earliest  start  time  constraints  are  propagated  downstream  within  the  job  whereas 
latest  start  time  constraints  are  propagated  upstream  (Figure  4).  The  complexity  of 
this  simple  propagation  mechanism  is  linear  in  the  number  of  precedence 
constraints.  In  the  absence  of  capacity  constraints  (e.g.  problems  in  which  no  two 
operations  require  the  same  resource),  the  procedure  can  be  shown  to  guarantee 
decomposability  [Davis  87,  Dechter  89b],  i.e.,  if  applied  in  each  search  state,  it  is 
sufficient  to  guarantee  backtrack-free  search  [Sadeh  91]. 

2.  Forward  consistency  checks  with  respect  to  capacity  constraints:  Enforcing 
consistency  with  respect  to  capacity  constraints  is  more  difficult  due  to  the 
disjunctive  nature  of  these  constraints.  Whenever  a  resource  is  allocated  to  an 
operation  over  some  time  interval,  a  "forward  checking"  mechanism  [Haralick 
80,  Nadel  88]  checks  the  set  of  remaining  possible  reservations  of  other  operations 
requiring  that  same  resource,  and  removes  those  reservations  that  would  conflict 
with  the  new  assignment,  as  first  proposed  in  [LePape  87]  (See  Figure  5). 

3.  Additional  consistency  checks  with  respect  to  capacity  constraints:  Additionally, 
our  consistency  enforcing  mechanism  checks  that  no  two  unscheduled  operations 
require  overlapping  resource/time  intervals.  An  example  of  such  a  situation  is 
illustrated  in  Figure  6,  where  two  operations  requiring  the  same  resource,  and 
Oj,  rely  on  the  availability  of  overlapping  time  intervals.  Whichever  start  time  is 

selected  for  operation  Of  (within  its  earliest/latest  start  time  window),  this 
operation  will  dways  require  its  resource  over  the  time  interval  that  spans  between 
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Fig.  4  Consistency  with  respect  to  precedence  constraints. 


' - Before  propagation:  [7,15] 

O3  5  R3  After  propagation:  [10,15] 
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I 

scheduled  to  start  at  time  6 
- -  capacity  constraint 


Fig.  5  Forward  consistency  checks  with  respect  to  capacity  constraints. 

its  latest  start  time  and  its  earliest  finish  time  {[ls^,eft'l]).  Similarly,  operation  Oj 
will  always  require  that  same  resource  between  its  latest  start  time  and  its  earliest 
finish  time  (interval  Interval  [ls/l,ef^]  and  [ls/j,eft^  overlap.  This 

represents  a  capacity  constraint  conflict.  This  additional  consistency  mechanism, 
which  enforces  a  higher  level  of  arc-consistency  than  forward  checking  [McGregor 
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79,  Haralick  80,  Nadel  88],  has  been  shown  to  often  increase  search  efficiency, 
while  only  resulting  in  minor  computational  overheads  [Sadeh  91]. 


earliest  possible  reservation 
latest  possible  reservation 

■■■■  time  interval  absolutely  required  by  the  operation, 
whatever  its  start  time 

Fig.  6  Detecting  situations  where  two  unscheduled  operations  requiring  the  same 

resource  are  in  conflict. 

Because,  it  is  only  possible  to  efficienUy  enforce  partial  consistency  with  respect  to  capacity 
constraints,  backtracking  will  sometimes  occur.  In  other  words,  the  scheduling  procedure  will 
sometimes  reach  a  search  state,  in  which  several  unscheduled  operations  competing  for  a 
resource  appear  to  each  have  some  possible  reservations  left,  while  the  total  capacity  available 
on  the  resource  is  actually  insufficient  to  simultaneously  accommodate  all  these  operations. 
Notice,  however,  that  because  consistency  enforcement  with  respect  to  precedence  constraints  is 
sufficient  to  guarantee  decomposability  (with  respect  to  precedence  constraints),  backtracking 
can  only  occur  as  the  result  of  capacity  constraint  violations. 

Because  it  is  impossible  to  efficiently  guarantee  backtrack-free  search  for  job  shop  CSPs, 
variable  and  value  ordering  heuristics  are  generally  critical  in  determining  the  actual  complexity 
of  the  search  procedure.  The  next  two  sections  examine  popular  variable  and  value  ordenng 
heuristics  developed  for  generic  CSPs  as  well  as  more  specialized  heuristics  and  identify  key 
weaknesses  of  these  heuristics  when  applied  to  job  shop  scheduling  problems. 
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4.  A  Look  At  Some  Popular  Variable  Ordering  Heuristics 

A  powerful  way  of  reducing  the  average  complexity  of  backtrack  search  is  to  judiciously  select 
the  order  in  which  variables  are  instantiated.  The  intuition  is  that,  by  instantiating  difficult 
variables  first,  backtrack  search  will  generally  avoid  building  partial  solutions  that  it  will  not  be 
able  to  complete  later  on.  This  reduces  the  chances  (i.e.  the  frequency)  of  backtracking. 
Instantiating  difficult  variables  first  can  also  help  reduce  the  amount  of  backtracking  when  the 
system  is  in  a  deadend  state  that  is  not  immediately  detected  by  its  consistency  checking 
mechanism.  Indeed,  by  instantiating  difficult  variables,  the  system  moves  to  more  constrained 
deadend  states  that  are  easier  to  detect.  This  reduces  the  time  the  system  wastes  attempting  to 
complete  partial  solutions  that  cannot  be  completed. 

One  can  distinguish  between  two  broad  types  of  variable  ordering  heuristics: 

1.  Fixed  variable  ordering  heuristics:  A  unique  variable  ordering  is  determined 
prior  to  starting  the  search  and  used  in  each  branch  of  the  search  tree; 

2.  Dynamic  variable  ordering  heuristics:  The  ordering  is  dynamically  revised  in 
each  search  state  in  order  to  account  for  earlier  assignments.  Different  branches  in 
the  search  tree  generally  entail  different  variable  orderings. 

Clearly,  fixed  variable  orderings  require  less  computation  since  they  are  determined  once  and 
for  all.  On  the  other  hand,  dynamic  variable  ordering  heuristics  are  potentially  more  powerful 
because  they  can  identify  difficult  variables  within  specific  search  states  rather  than  for  the 
overall  search  tree.  While  a  number  of  early  CSP  studies  performed  on  simple  problems  such  as 
N-queens  or  on  moderate-size  CSPs  seemed  to  suggest  that  dynamic  variable  ordering  heuristics 
might  be  too  expensive,  Purdom  showed  that  there  are  more  difficult  CSPs,  for  which  dynamic 
variable  ordering  heuristics  can  be  expected  to  achieve  exponential  savings  in  the  average 
amount  of  search  required  to  come  up  with  a  solution  [Purdom  83].  For  these  more  difficult 
classes  of  problems,  the  CSP  literature  generally  recommends  using  a  simple  heuristic  known  as 
Dynamic  Search  Rearrangement  (DSR)  [Bitner  75,  Purdom  83,  Dechter  89a,  Ginsberg 
90,  Dechter  94].  In  each  search  state,  DSR  looks  for  the  variable  with  the  smallest  number  of 
remaining  values,  and  selects  this  variable  to  be  instantiated  next.  DSR  has  often  been  used  as  a 
benchmark  to  determine  whether  it  is  worthwhile  using  a  dynamic  variable  ordering  heuristic  for 
a  given  class  of  problems.  Not  only  do  the  experiments  presented  at  the  end  of  this  paper  clearly 
show  that  job  shop  scheduling  belongs  to  the  class  of  more  difficult  problems  for  which  a 
dynamic  variable  ordering  is  justified,  they  also  clearly  indicate  that  DSR  is  too  weak  a  heuristic 
for  the  job  shop  CSP. 

The  scheduling  problem  introduced  in  Figure  2  helps  understand  the  shortcomings  of  this 
variable  ordering  heuristic.  Figure  7  depicts  this  problem  after  application  of  the  consistency 
enforcing  procedure  described  in  Section  3. 
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Fig.  7  The  same  job  shop  CSP  after  consistency  labeling. 

Start  time  labels  are  represented  as  intervals.  For 
instance,  [0,6]  represents  all  start  times  between  time  0 
and  time  6,  as  allowed  by  the  time  granularity,  namely 
{0,1,2,3,4,5,6}. 

According  to  DSR,  six  operations  appear  to  be  equally  good  candidates  to  be  scheduled  first, 
namely  Oj,  0\,  0\,  Of,  and  O3,  as  they  each  have  seven  possible  start  times  (values)  left, 
while  the  other  four  operations  have  ten  possible  start  times  (values).  It  is  easy  to  see  however 
that,  among  these  six  "critical"  operations,  some  are  in  fact  more  difficult  to  schedule  than 
others.  Consider  operations  O2  and  0\.  Both  require  resource  R2,  which  is  required  by  a  total  of 
four  operations.  Additionally,  three  out  of  the  four  operations  requiring  resource  ^2  are  the  last 
operations  in  their  jobs.  In  other  words,  most  of  these  operations  appear  to  be  in  contention  for 
resource  R2  at  about  the  same  time.  This  high  contention  for  resource  R2  strongly  suggests  that 
0\  and  are  more  difficult  to  schedule  than  the  other  four  operations  with  seven  possible  start 
times.  For  instance,  an  operation  like  (7j,  which  has  also  seven  possible  start  times,  competes 
only  with  one  other  operation  for  resource  R^,  namely  operation  0\.  Additionally,  d\  is  the  first 
operation  in  job  while  0\  is  the  last  operation  in  its  job  (job  73).  In  other  words,  these  two 
operations  are  not  in  high  contention  for  their  resource  (resource  R3),  and  hence  are  expected  to 
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be  easier  to  schedule  than  operations  Oj  and  0^.  Unfortunately,  DSR  cannot  account  for  these 
observations.  It  simply  counts  the  number  of  remaining  values  of  each  variable,  but  fails  to 
estimate  the  likelihood  that  these  values  remain  available  later  on.  Clearly  start  times  of 
operations  competing  for  highly  contended  resources  are  more  likely  to  become  unavailable  than 
those  of  other  operations. 

In  this  example,  the  bottleneck  resource  /?2  also  corresponds  to  the  largest  clique  of  capacity 
constraints.  Therefore,  a  variable  ordering  heuristic  that  identifies  difficult  variables  (i.e.  nodes 
in  the  constraint  graph)  as  those  with  many  incident  constraints  might  actually  perform  better 
than  DSR.  Several  such  variable  ordering  heuristics  have  been  proposed  in  the  literature.  These 
heuristics  are  generally  fixed  variable  ordering  heuristics,  unless  new  constraints  are  added  to  the 
problem  as  it  is  solved.  One  such  heuristic  is  the  Minimum  Width  (MW)  heuristic  [Freuder 
82,  Dechter  89a].  MW  "orders  the  variables  from  last  to  first  by  selecting,  at  each  stage,  a  node 
in  the  constraint  graph  which  has  a  minimal  degree^  in  the  graph  remaining  after  deleting  all 
nodes  that  have  already  been  selected!'  [Dechter  89a].  A  variation  of  this  heuristic  known  as  the 
Minimum  Degree  (MD)  heuristic  simply  ranks  variables  according  to  their  degree  in  the  initial 
constraint  graph  [Dechter  89a].  In  the  example  depicted  in  Figure  2,  MD  would  select  0\  to  he 
scheduled  first.  There  are  also  MW  orderings  starting  with  this  operation.  In  general,  scheduling 
problems  are  not  that  simple,  and  fixed  variable  ordering  heuristics  like  MD  or  MW  do  not 
provide  very  good  advice  either.  This  is  best  illustrated  by  slightly  modifying  the  scheduling 
problem  depicted  in  Figure  2. 

Suppose,  for  instance,  that  we  change  the  problem  and  introduce  a  fifth  resource,  say  R^. 
Suppose  also  that  we  allow  any  of  the  operations  requiring  Rj  or  R3  in  the  original  problem  to 
use  R5  as  an  alternative  resource.  We  now  have: 

.Q;i=Q5i=Q^i  =  {Ri,R5} 

•  Q31  =Ojj  =  [Rs  ,R5} 

The  two  cliques  of  capacity  constraints  corresponding  to  Rj  and  R3  are  now  subsumed  by  a 
larger  clique  of  capacity  constraints  involving  five  operations:  0\,  O3,  Of,  Oj,  and  Ol  (Figure  8). 
Notice  that  capacity  constraints  between  operations  belonging  to  the  same  job  are  subsumed  by 
precedence  constraints  in  that  job.  This  is  the  case  for  the  capacity  constraint  between  and 
O2,  which  would  require  that  either  0\  precede  0\  or  0\  precede  d\,  if  both  operations  use  R5. 
This  constraint  is  subsumed  by  the  precedence  constraint  between  the  two  operations,  which 
requires  that  d\  always  precede  Due  to  the  additional  capacity  constraints  resulting  from  the 
introduction  of  R5,  there  are  now  MW  orderings  and  MD  orderings  starting  with  some  of  these 
five  operations.  In  fact  the  addition  of  R5  has  significantly  loosened  the  capacity  constraints 


"^The  degree  of  a  node  is  the  number  of  constraints  incident  to  that  node. 
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Fig.  8  A  new  resource  is  added  to  the  problem. 

/?j  5  stands  for  or  R^.  /?3  5  stands  for  R^  or  R^. 

participating  in  the  new  clique,  and  the  operations  connected  by  these  constraints  are  even  easier 
to  schedule  than  before.  Failure  of  MW  and  MD  to  identify  that  these  operations  are  actually 
easy  to  schedule  is  due  to  the  inability  of  these  heuristics  to  account  for  constraint  tightness, 
namely  the  difficulty  of  satisfying  a  specific  constraint  [Nadel  86,  Fox  89].  Another  example  of 
a  variable  ordering  heuristic  that  does  not  account  for  constraint  tightness  is  the  Max 
Cardinality  (MC)  search  order  which  arbitrarily  selects  the  first  variable  to  be  instantiated,  and 
then  at  each  stage  picks  the  variable  connected  to  the  largest  number  of  already  instantiated 
variables  [McGregor  79,  Dechter  89a].  This  heuristic  can  also  be  viewed  as  a  fixed  variation  of 
DSR. 

Another  weakness  of  generic  variable  ordering  heuristics  described  in  the  CSP  literature  comes 
from  the  fact  that  they  treat  all  problem  constraints  uniformly.  In  many  practical  CSPs,  different 
types  of  constraints  entail  different  levels  of  consistency  checking.  This  in  turn  impacts  the 
effectiveness  of  different  variable  ordering  heuristics.  For  instance,  in  the  job  shop  CSP, 
consistency  enforcing  techniques  can  efficiently  ensure  that  backtracking  only  occurs  as  a  result 
of  capacity  constraint  violations,  as  explained  in  Section  3.  Consequently,  the  criticality  of  an 
operation  should  solely  be  a  function  of  how  difficult  it  is  to  find  that  operation  a  reservation  that 
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does  not  violate  any  capacity  constraints.  This  can  be  exploited  to  design  more  effective  variable 
ordering  heuristics. 

A  specialized  variable  ordering  heuristic  that  takes  advantage  of  this  observation  is  the  one 
developed  by  Keng  and  Yun  [Keng  89],  though  its  authors  apparently  failed  to  relate  the  strength 
of  their  heuristic  to  this  observation.  Keng  and  Yun  suggested  a  generalization  of  DSR  in  which 
each  operation  reservation  (i.e.  each  value)  is  assigned  a  survivability  measure  reflecting  its 
chance  of  satisfying  the  capacity  constraints  (i.e.  its  chance  of  surviving  contention  with  other 
operations  for  the  allocation  of  its  resource).  The  operation  to  be  scheduled  next  is  the  one  with 
the  smallest  global  survivability,  as  determined  by  the  sum  of  the  survivabilities  of  each  of  its 
(remaining)  possible  reservations.  Experiments  presented  at  the  end  of  this  paper,  show  that  this 
heuristic  performs  better  than  all  the  generic  heuristics  described  above.  They  also  show  that  this 
heuristic  is  quite  expensive,  as  it  requires  inspecting  all  the  remaining  reservations  (i.e.  values)  of 
all  unscheduled  operations^.  In  scheduling  problems  with  several  hundred  operations  or  more, 
each  with  several  hundred  possible  start  times  and  several  possible  resources,  this  heuristic  may 
not  be  cost  effective.  More  efficient  heuristics  can  be  obtained  by  focusing  on  one  or  a  small 
number  of  cliques  of  tight  capacity  constraints,  and  selecting  the  operation  most  likely  to  violate 
a  constraint  in  these  cliques.  A  heuristic  based  on  this  idea  is  described  in  Section  6,  which  runs 
faster  than  Keng  and  Yun’s  heuristic  while  achieving  an  even  higher  search  efficiency. 


^Notice  also  that  this  heuristic  may  still  identify  operations  with  just  a  few  remaining  possible  reservations  as 
critical  while  in  fact  the  reservations  of  these  operations  may  not  be  in  contention  with  those  of  any  other  operations. 
This  could  be  the  case  if  operation  in  the  example  in  Figure  2  had  only  a  small  number  of  possible  start  times.  In 
fact,  consistency  enforcing  is  sufficient  to  ensure  that  backtracking  will  never  be  caused  by  this  operation,  since 
there  is  no  capacity  constraint  incident  to  it. 
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5.  A  Look  At  Some  Popular  Value  Ordering  Heuristics 

Another  powerful  way  of  reducing  the  average  complexity  of  backtrack  search  relies  on 
judiciously  selecting  the  order  in  which  possible  values  are  tried  for  each  variable.  A  good  value 
ordering  heuristic  is  one  that  assigns  least  constraining  values.  A  least  constraining  value  is  one 
that  is  expected  to  participate  in  many  solutions  to  the  overall  problem  or,  better ,  one  expected  to 
participate  in  a  large  number  of  solutions  compatible  with  the  current  search  state.  By  first 
trying  least  constraining  values,  the  system  will  generally  maximize  the  number  of  values  left  to 
variables  that  still  need  to  be  instantiated,  and  hence  it  it  will  avoid  building  partial  solutions  that 
cannot  be  completed. 

Attempting  to  exactly  compute  the  number  of  global  solutions  in  which  a  given  assignment  (or 
value)  participates  would  be  futile  as  it  would  require  finding  all  solutions  to  the  problem. 
Instead,  Dechter  and  Pearl  have  developed  an  Advised  BackTracking  (ABT)  value  ordering 
heuristic  that  relies  on  tree-like  relaxations  of  the  problem  to  estimate  the  goodness  of  a  value.  A 
tree-like  relaxation  of  a  CSP  is  one  whose  constraint  graph  is  a  tree  that  spans  some  or  all  the 
nodes  (i.e.  variables)  of  the  original  CSP.  It  turns  out  that,  within  such  relaxations,  the  number  of 
solutions  in  which  a  value  participates  can  be  efficiently  computed  in  0{nl^)  steps,  where  n  is 
the  number  of  variables  in  the  CSP,  and  k  the  maximum  number  of  possible  values  of  a  variable. 
The  idea  is  that,  if  one  can  find  a  tree-like  relaxation  that  is  close  enough  to  the  original  CSP,  a 
good  value  for  the  relaxation  should  also  be  a  good  value  for  the  original  CSP.  One  way  to 
obtain  tight  tree-like  relaxations  is  to  associate  with  each  (binary)  constraint  C  in  the  original 
constraint  graph  a  weight  w( C)  equal  to  the  satisfiability  of  that  constraint  (i.e.  the  number  of 
value  pairs  that  satisfy  the  constraint).  A  tight  tree-like  relaxation  can  then  be  obtained  by 
looking  for  a  Minimum  Spanning  Tree  (MST)  in  the  resulting  network. 

Even  for  a  fixed  variable  ordering,  this  heuristic  generally  requires  the  computation  of  a  fixed 
MST  for  each  of  the  n  levels  in  the  search  tree.  This  amounts  to  n  MST  computations,  each  of 
which  typically  requires  Oirfi)  elementary  computations  [Tarjan  83],  hence  a  total  of  0{n  ) 
elementary  computations.  Empirical  results  presented  in  Section  8  indicate  that  a  fixed  variable 
ordering  is  generally  not  enough  to  efficiently  solve  job  shop  scheduling  problems.  Under  these 
conditions,  it  might  even  be  necessary  to  identify  new  tree-like  relaxations  in  each  search  state. 
This  in  turn  would  require  updating  the  weights  of  each  constraint  in  each  search  state.  The 
resulting  computations  can  become  quite  expensive  for  large  CSPs.  More  generally,  while  ABT 
has  been  reported  to  perform  particularly  well  on  some  classes  of  CSPs,  it  does  not  seem  to  lend 
itself  very  well  to  tightly  connected  CSPs  such  as  job  shop  scheduling,  whether  using  minimum 
spanning  tree  relaxations  or  not.  Indeed,  when  dealing  with  tightly  connected  CSPs  such  as  job 
shop  CSPs,  it  is  unlikely  that  one  can  find  a  tight  tree-like  relaxation,  namely  a  tree-like 
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relaxation  that  will  provide  sufficiently  good  advice  to  guide  search^.  This  is  illustrated  below 
with  an  example. 

Consider  constraint  Pj  in  the  scheduling  problem  depicted  in  Figure  7.  is  a  precedence 
constraint  between  operation  0\  and  operation  0\.  The  set  of  start  time  pairs  (5?} ,  satisfy 

constraint  P^  is: 

{(0,3),(0,4),...,(0,9),(1,4),(1,5),...,(1,9),...,(6,9)} 

In  order  to  identify  a  tight  tree-like  relaxation,  P^  is  assigned  a  weight,  w(Pj),  equal  to  the 
cardinality  of  that  set,  namely  w(Pi)=7+6+5+4+3+2+l=28.  Similar  computations  can  be 
performed  to  compute  the  weights  of  other  constraints.  These  weights  are  as  follows: 

•  w(P^)=w(P2)=w(P4)=w(P5)=28 


•  w(P3)=w(P5)=55 

•  w(Ci)=38,  w(C2)=29,  w(C3)=38 


•  w(C4)=43 


•  w(C5)=w(C6)=38  ,  w(Cj)=29  ,  w(C^)=56  ,  w(C9)=w(Cio)=38 

Figure  9  shows  an  MST  relaxation  of  the  scheduling  problem  obtained  using  these  weights.  It 
appears  that  the  MST  relaxation  includes  10  out  of  the  16  constraints  present  in  the  original  CSP. 
The  loss  of  information  initially  contained  in  the  cliques  of  capacity  constraints  is  even  more 
dramatic.  Only  2  out  of  the  6  constraints  in  the  clique  corresponding  to  R2  have  been  preserved. 
This  is  not  an  accident.  In  general  a  resource  required  by  M  operations  will  result  in  a  clique  of 
capacity  constraints.  At  most  M-1  of  these  capacity  constraints  can  be  preserved  in  any 

tree-like  relaxation  of  the  problem.  Under  these  conditions,  we  should  not  be  surprised  if  the 
advice  provided  by  ABT  for  job  shop  CSPs  is  not  very  effective.  Suppose  for  instance  that  the 
system  selects  0\  to  be  instantiated  first’^.  Using  the  MST  relaxation  represented  in  Figure  9, 
ABT  would  recommend  assigning  start  time  4  to  this  operation.  A  careful  examination  of  the 
scheduling  problem  reveals  however  that  there  is  no  feasible  schedule  with  0\  starting  at  4.  If 
0\  were  to  start  at  time  4,  the  other  three  operations  requiring  resource  R2  would  all  have  to  be 


^The  experiments  reported  in  [Dechter  88]  seemed  to  indicate  the  opposite.  In  these  experiments,  it  appeared  that 
often  the  advice  provided  by  ABT  was  too  expensive  and  too  accurate.  Instead,  advice  provided  by  looser 
relaxations  ended  up  being  more  cost-effective.  However,  these  results  were  obtained  on  rather  small  problems  with 
a  relatively  high  density  of  solutions. 

^It  should  now  be  clear  that  this  is  a  good  choice,  since  this  operation  has  only  seven  possible  start  times  and 
requires  resource  the  main  bottleneck  of  the  problem. 
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[0,9]  [3.12] 


_  capacity  constraint 

p 

^  ^  precedence  constraint 

Fig.  9  An  MST  relaxation  of  the  scheduling  problem, 
scheduled  between  time  7  and  time  15.  Given  that  each  of  these  operations  has  a  duration  of  3 
time  units,  this  is  clearly  impossible. 

Keng  and  Yun  have  developed  a  specialized  value  ordering  heuristic  that  can  deal  more 
effectively  with  cliques  of  capacity  constraints  [Keng  89].  This  heuristic  first  estimates  overall 
contention  for  each  resource  as  a  function  of  time.  Based  on  these  estimates,  operation 
reservations  are  ranked  according  to  how  well  they  are  expected  to  prevent  contention  with  the 
resource  requirements  of  other  operations.  Empirical  results  in  Section  8  show  that  Keng  and 
Yun’s  value  ordering  heuristic  generally  outperforms  ABT.  However  their  heuristic  does  not 
attempt  to  leave  enough  room  to  other  operations  within  the  same  job  so  that  they  too  can  be 
assigned  least  constraining  reservations.  In  other  words,  Keng  and  Yun  s  heuristic  only  accounts 
for  capacity  constraints  incident  to  the  current  operation,  but  fails  to  account  for  capacity 
constraints  incident  to  other  operations  within  the  same  job. 

The  next  section  describes  a  probabilistic  model  of  the  search  space  that  better  accounts  for  the 
high  connectivity  of  constraint  graphs  typically  found  in  job  shop  scheduling,  and  for  the 
constraint  interactions  induced  by  these  graphs.  New  variable  and  value  ordering  heuristics  are 
defined  within  this  framework  that  attempt  to  remedy  the  shortcomings  identified  above. 
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6.  New  Variable  and  Value  Ordering  Heuristics 
6.1.  General  Considerations 

Good  variable  and  value  ordering  heuristics  are  heuristics  that  minimize  the  time  required  for 
search  to  complete  (i.e.  either  with  a  solution,  if  one  exists,  or  with  the  answer  that  the  problem 
is  overconstrained).  If  the  problem  is  infeasible,  search  time  is  independent  of  the  value  ordering 
heuristic  (except  for  the  time  spent  applying  the  heuristic):  once  a  variable  has  been  selected,  the 
system  has  to  try  each  one  of  its  remaining  values  to  conclude  that  the  current  partial  solution 
cannot  be  completed.  In  general  variable  and  value  ordering  heuristics  affect  the  number  of 
search  states  that  are  explored,  the  average  amount  of  time  spent  enforcing  consistency  in  each 
search  state,  and  the  amount  of  time  spent  applying  these  heuristics.  Variable  and  value  ordering 
heuristics  can  also  affect  each  other’s  performance.  The  complexity  of  these  interactions 
precludes  the  design  of  heuristics  that  directly  minimize  the  expected  search  time.  Instead,  our 
approach  aims  at  developing  heuristics  that  efficiently  reduce  the  expected  number  of  search 
states  that  need  to  be  explored.  Assuming  that  the  time  spent  enforcing  consistency  is  mainly  a 
function  of  the  number  of  operations  that  have  already  been  scheduled  (i.e.  the  depth  in  the 
search  tree)  rather  than  a  function  of  the  specific  operations  that  have  been  scheduled,  this 
approach  is  in  effect  expected  to  yield  heuristics  that  reduce  search  time  as  well. 

We  postulate  that  a  critical  variable  is  one  that  is  expected  to  cause  backtracking,  namely  one 
whose  remaining  possible  values  are  expected  to  conflict  with  the  remaining  possible  values  of 
other  variables.  Under  a  set  of  simplifying  independence  assumptions,  Haralick  and  Elliott  have 
shown  that  a  variable  ordering  heuristic  based  on  such  a  criticality  measure  will  minimize  the 
expected  length  of  branches  in  the  search  tree,  and  hence  the  total  number  of  search  states  that 
need  to  be  visited  to  come  up  with  a  solution  [Haralick  80]^.  We  also  postulate  that  a  good  value 
is  one  that  is  expected  to  participate  in  many  solutions  compatible  with  the  current  search  state. 

In  the  next  subsection,  we  introduce  a  probabilistic  model  of  the  search  space,  which  we  will 
use  to  compute  estimates  of  variable  criticality  and  value  goodness. 


*See  [Haralick  80]  pp.  307-312.  At  the  end  of  their  proof,  the  authors  make  the  unnecessary  assumption  that  each 
variable  value  is  equally  likely  to  become  unavailable.  Under  this  assumption,  the  variable  with  what  they  call  the 
smallest  success  probability  (or  equivalently  the  variable  most  likely  to  create  backtracking)  is  the  one  with  the 
smallest  number  of  remaining  values.  The  authors  exploit  this  result  to  motivate  their  Dynamic  Search 
Rearrangement  heuristic.  When  this  last  assumption  is  omitted,  Haralick  and  Elliott’s  proof  shows  that  (under 
several  other  simplifying  assumptions  made  earlier  in  their  proof)  choosing  the  variable  most  likely  to  create 
backtracking  will  minimize  the  expected  length  of  each  branch  in  the  search  tree. 
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6.2.  A  Probabilistic  Model  of  the  Search  Space 

A  critical  variable  is  one  expected  to  be  involved  in  a  conflict.  To  approximate  variable 
criticality,  we  introduce  a  probabilistic  framework  that  accounts  for  (1)  the  chance  that  a  given 
value  will  be  assigned  to  a  variable  (or  the  reliance  of  a  variable  on  a  particular  value)  and  (2) 
the  chances  that  values  assigned  to  different  variables  conflict  with  each  other  (measures  of 
value  contention),  taking  into  account  only  those  conflicts  that  cannot  be  prevented  by  the 
consistency  enforcing  procedure.  Given  that  the  only  conflicts  that  cannot  be  prevented  by  our 
consistency  enforcing  procedure  are  capacity  constraint  violations,  a  critical  operation  is  one 
whose  resource  requirements  are  likely  to  conflict  with  the  resource  requirements  of  other 
unscheduled  operations. 

We  consider  a  probabilistic  model  in  which  each  remaining  reservation/value  p  of  an 
unscheduled  operation  0\  is  assigned  a  subjective  probability  <j|(p)  to  be  allocated  to  that 
operation.  Because,  a  priori,  there  is  no  reason  to  believe  that  one  reservation  is  more  likely  to 
be  selected  than  another,  each  operation  reservation  is  assigned  an  equal  probability  to  be 
selected.  Clearly,  in  any  given  schedule,  an  operation  will  be  assigned  only  one  reservation, 
hence: 


where  NBR^^  is  the  number  of  remaining  reservations  of  O-  in  the  current  search  state.  This 
distribution  mirrors  our  intuition  that  an  operation  with  many  possible  reservations  does  not 
heavily  rely  on  any  one  of  its  remaining  reservations,  and  hence  the  probability  of  anyone  of 
these  reservations  to  be  selected  is  rather  low.  On  the  other  hand,  operations  with  few  remaining 
reservations  rely  more  heavily  on  each  of  their  remaining  reservations. 

Using  these  subjective  reservation  distributions,  we  can  estimate  the  reliance  of  an  operation 
d.  on  the  availability  of  a  resource  €  RES  at  time  T  as  the  probability  that  the  reservation 
allocated  to  this  operation  will  require  that  resource  at  that  time.  We  refer  to  this  probability  as 
the  individual  demand  of  operation  Oj  for  resource  at  time  T  and  denote  it  D^iRf^,x).  D-{Ri^,x) 
can  simply  be  computed  by  adding  the  probabilities  C5|(p)  of  all  remaining  reservations  p  of 
operation  0\  that  require  resource  Rj^  at  time  x. 

By  adding  the  individual  demands  of  all  unscheduled  operations  requiring  resource  an 
aggregate  demand  profile,  is  obtained  that  measures  contention  between  unscheduled 

operations  for  resource  as  a  function  of  time. 

Equivalently,  if  we  were  to  assume  a  stochastic  mechanism  that  completes  the  current  partial 
schedule  (solution)  by  randomly  assigning  a  reservation  (value)  to  each  unscheduled  operation 
(variable)  0\  based  on  its  g\  distribution,  d\{Rj^,x)  would  be  the  probability  that  the  stochastic 
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mechanism  assigns  operation  o\  a  reservation  that  requires  Rj^  at  time  %  and  would  be  the 

expected  number  of  reservations  for  Rj^  at  time  x  (or  the  expected  number  of  operations  requiring 
that  resource  at  that  time). 

Similar  demand  profiles  are  built  by  Keng  and  Yun’s  heuristics  [Keng  89].  Our  variable  and 
value  ordering  heuristics  differ  from  those  of  Keng  and  Yun  in  the  way  they  exploit  these 
demand  profiles^.  Earlier,  Muscettola  and  Smith  also  proposed  techniques  to  build  probabilistic 
demand  profiles,  based  on  a  predefined  variable  ordering  [Muscettola  87]. 

The  following  illustrates  the  construction  of  these  profiles  for  the  example  introduced  in  Figure 

2. 

Consider  operation  0\  in  the  initial  search  state  depicted  in  Figure  7.  After  enforcing 
consistency,  this  operation  has  7  possible  reservations  (i.e.  start  times  st\=3  ,A, . . .  ,9),  each  with  a 
probability  to  be  selected.  Similarly,  O2  has  10  possible  start  times  and  hence 

c5(5r2)=4  54=3,4,. ..,12. 

The  individual  demand  of  operation  0\  for  resource  /?2  ti^ie  t  can  be  obtained  by  adding  the 
probabilities  of  all  its  possible  reservations  starting  between  t  and  t-duf. 

D\(R2,t)=  ^  a‘(x) 

For  instance,  dI(R2 ,t)=lj  fox  3  <t <4  and £>2(^2 ,t)=jfor4<t<  5.  Similar  computations  can 

be  performed  for  the  other  time  intervals  over  which  0\  may  require  resource  /?2-  Figure  10 
shows  the  individual  demands  of  all  four  operations  requiring  resource  i?2,  well  as  the 
aggregate  demand  for  that  resource  obtained  by  adding  the  individual  demands  of  these  four 
operations  over  time.  As  expected,  the  two  operations  with  only  seven  possible  start  times 
(namely  0\  and  O3)  have  more  compact  individual  demands  than  the  two  operations  with  ten 
possible  start  times  (namely  0\  and  Oj).  Notice  also,  that,  because  of  the  normalization  of  the 
a|(p)  distributions,  the  total  individual  demand  of  an  operation  with  only  one  possible  resource 
(like  all  the  operations  in  this  example)  is  always  equal  to  the  duration  of  that  operation.  This 
total  demand  is  simply  spread  differently  over  time,  depending  on  the  number  of  start  times  still 
available  to  the  operation. 

Figure  1 1  displays  aggregate  demands  for  all  four  resources  in  the  example.  As  anticipated, 
resource  /?2  is  the  most  contended  for. 


^The  work  presented  here  was  performed  concurrently  with  Keng  and  Yun’s  [Sadeh  88,  Sadeh  89a,  Fox  89]. 
Notice  also  that  Keng  and  Yun’s  interpretation  of  their  demand  profiles  is  not  a  probabilistic  one. 
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D\{%y.  Individual  Demand  of  0\  for  /?2 
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Fig.  10  Building  /?2’s  aggregate  demand  profile  in  the  initial  search  state. 

In  general,  building  aggregate  demand  profiles  requires  looking  at  each  remaining  reservation 
of  each  unscheduled  operation.  Hence,  in  each  search  state,  the  complexity  of  this  procedure  is 
0(Nk),  where  N  is  the  number  of  unscheduled  operations  and  k  the  number  of  remaining 
reservations  of  an  unscheduled  operation.  In  practice,  the  sets  of  remaining  reservations  of  many 
operations  do  not  change  from  one  search  state  to  another.  Accordingly,  the  computation  of 
demand  profiles  could  potentially  be  made  more  efficient  by  dynamically  updating  individual 


Fig.  11  Aggregate  demands  in  the  initial  search  state  for  each  of  the  four  resources. 


demands  of  operations  when  their  sets  of  possible  reservations  shrink  (i.e.  subtracting  their  old 
individual  demands  from  the  aggregate  demand  profiles  and  adding  the  new  ones).  Empirical 
results  presented  in  Section  8  were  obtained  using  a  procedure  that  did  not  take  advantage  of  this 
observation. 
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6.3.  A  Variable  Ordering  Heuristic  Based  on  Measures  of  Resource  Contention 

The  aggregate  demand  for  a  resource  over  a  time  interval  is  a  measure  of  contention  between 
unscheduled  operations  for  that  resource/time  interval.  The  resource/time  interval  with  the 
highest  demand/contention  can  be  expected  to  be  the  one  where  capacity  constraints  are  most 
likely  to  be  violated  (specifically,  the  capacity  constraints  that  connect  operations  contributing  to 
the  demand  for  this  resource/time  interval).  Accordingly,  the  operation  with  the  highest 
contribution  to  the  demand  for  the  most  contended-for  resource/time  interval  can  be  considered 
the  most  critical  one.  This  is  the  operation/variable  most  likely  to  be  involved  in  a  conflict.  It  is 
also  the  operation  that  relies  most  on  the  availability  of  the  highly  contended-for  resource/time 
interval. 

Several  variations  of  this  variable  ordering  heuristic  have  been  implemented.  The  simplest  and 
often  most  effective  one  inspects  each  resource’s  aggregate  demand  profile  using  time  intervals 
of  duration  equal  to  the  average  duration  of  the  operations  requiring  that  resource.  The  heuristic 
then  picks  the  resource/time  interval  with  the  highest  demand  and  the  operation  with  the  largest 
contribution  to  this  resource/time  interval.  This  is  the  variable  ordering  heuristic  used  in  the 
empirical  study  reported  in  Section  8.  We  refer  to  it  as  ORR  (for  "Operation  Resource 
Reliance"  heuristic). 

Figure  11  displays  the  demand  profiles  of  ^2-  -^3’  ^4’  resources  in  our 

example.  The  highest  demand  peak  is  the  one  on  resource  /?2  between  time  8  and  1 1 .  This 
resource/time  interval  corresponds  precisely  to  the  clique  of  tight  capacity  constraints  identified 
earlier.  Figure  12  indicates  that  the  operation  with  the  largest  contribution  to  the  demand  for  this 
peak  is  Oy  This  is  no  coincidence:  O3  competes  for  the  most  contended  resource  and  belongs  to 
the  group  of  six  operations  that  have  only  seven  possible  start  times  left  after  consistency 
checking.  Notice  that,  in  this  example,  there  are  actually  two  intervals  in  the  demand  profile  of 
R2  that  qualify  as  most  contended  for:  [7,10[  and  [8,11[.  Had  our  heuristic  chosen  [7,10[  instead 
of  [8,11[,  it  would  have  selected  O2  us  the  operation  to  be  scheduled  next.  In  fact,  and  O2 
appear  equally  critical  in  this  example. 

The  ORR  heuristic  requires  looking  successively  at  each  resource,  and  each  time  interval  on 
that  resource’s  calendar,  in  order  to  identify  the  most  contended  interval.  If  there  are  m  resources 
and  if  the  scheduling  horizon  is  H,  this  requires  0(Hm)  elementary  computations. 

6.4.  A  Reservation  Ordering  Heuristic  that  Attempts  to  Minimize  Contention 

In  Section  4,  we  showed  that  the  computational  overhead  associated  with  ABT’s  selection  of 
Minimum  Spanning  Tree  relaxations  could  become  prohibitive  on  large  job  shop  CSPs  and  is 
often  unlikely  to  help  due  to  the  difficulty  of  tree-like  relaxations  to  properly  account  for  cliques 
of  capacity  constraints.  We  now  describe  a  value  ordering  heuristic  that  attempts  to  minimize 
resource  contention  while  relying  on  predetermined  tree-like  relaxations.  The  predetermined 


26 


1,50 

5  1,25  - 

5  1.00  - 
^  0.75^ 

n  0.50  - 
0.25^ 
0.00-~ 


Aggregate  Demand  for  /?2 


time 


•o 

c 

i 


D^Cx):  Individual  Demand  of  0\  for  i?2 

0.50^ 

0.25.. 

0.00  \ - ^ - p 

0  1  2 

time 


s 

6 


dI(x):  Individual  Demand  of  ol  for  i?2 

0.50 
0.25- 

0.00  4 — I — r 
0  1  2 

time 


£>3(1):  Individual  Demand  of  £>3  for  R2 

"g  0.S0-, 

S  0.25  J 

^  n  I 


time 


D^ix):  Individual  Demand  of  Ot  for  R 


time 


Fig.  12  ORR  Heuristic:  the  most  critical  operation  is  the  one  that  relies 
most  on  the  most  contended  resource/time  interval. 

tree-like  relaxations  are  comprised  of  some  or  all  unscheduled  operations  in  the  job  to  which  the 
current  critical  operation  (i.e.  the  operation  to  be  scheduled  next)  belongs,  along  with  all 
precedence  constraints  between  these  operations.  However,  rather  than  simply  counting  the 
number  of  solutions  to  these  relaxations,  our  value  ordering  heuristic  also  accounts  for  the 
probability  that  a  solution  to  the  relaxation  satires  the  cliques  of  capacity  constraints.  The 
probability  that  a  solution  (to  the  relaxation)  satisfies  the  cliques  of  capacity  constraints  (or 
"survives"  resource  contention)  is  estimated  using  the  same  demand  profiles  that  are  constructed 
for  the  ORR  variable  ordering  heuristic. 
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For  job  shop  CSPs  with  tree-like  process  routings,  the  tree-hke  relaxation  adopted  by  our  value 
ordering  heuristic  is  comprised  of  aU  the  unscheduled  operations  connected  by  precedence 
constraints  to  the  current  critical  operation,  along  with  these  precedence  constraints.  Each 
candidate  reservation  (for  the  critical  operation)  is  ranked  according  to  the  number  of  solutions 
to  the  relaxation  with  which  it  is  compatible  that  are  expected  to  satisfy  capacity  constramts  (or 
"survive"  resource  contention).  The  reservation  compatible  with  the  largest  number  of  such 
schedules  is  the  one  selected  by  our  value  ordering  heuristic.  Below,  we  detail  the 
approximations  used  in  our  value  ordering  heuristic  to  compute  the  probability  that  a  reservation 
and  a  solution  to  the  relaxation  "survive"  resource  contention. 

6.4.1.  Estimating  the  Probability  that  a  Reservation  Survives  Contention 
Let  0\  be  an  unscheduled  operation  and  p=<^t,=L^,i— ^ 
remaining  reservations.  We  refer  to  the  probabUity  that  assigning  reservation  p  to  operation  O, 
will  not  conflict  with  the  resource  requirements  of  other  operations  as  the  "summbihty  ^  of 
reservation  p  (for  o').  It  will  be  denoted  rurvifp).  The  survivability  of  reservation  p  (for  O,)  is 
approximated  by  the  product  of  the  probabiUty  that  each  one  of  the  resources  required  by  that 
reservation  will  be  available  between  <  and  i+du'  (independence  assumption): 

surv\{p)—  P  avail^(r^ji.,t,t+du^) 


where  nvai;!(r!.i,<,(+<iii|)  stands  for  the  probability  that  resource  4  will  not  be  required  by  any 
other  operation  between  1  and  r+ifa'  (or  the  probability  that  assigning  this  resource  to  O,  wiU  not 

create  backtracking). 

Let  r^=R  e  RES.  The  probability  avail\{r\j^,t,t+du)  that  resource  ^^=2?^  will  not  be 
required  by  my  other  operation  between  (  and  (+<*.'  can  be  approximated  using  the  aggregate 
demand  profile  of  resource  R.  introduced  in  Subsection  6.2.  Our  value  ordering  heuristic  also 
requires  keeping  track  of  n.(r),  namely  the  number  of  (unscheduled)  operations  competing  for 
R  at  time  t,  which  is  also  the  number  of  operations  contributing  to  the  aggregate  demand  for  R^ 

at  time  T,  denoted  £>^^^'‘(t). 

P 

At  any  time  r  <  x  <  t+diJ^  ,  there  are  by  definition  1  unscheduled  operations  competing 

with  operation  0‘  for  resource  The  total  demand  of  these  other  unscheduled  operations  for 
R  at  time  x  is  D‘‘f^(x)-D\(Rp,x).  Assuming  that  each  of  these  «p(x)-l  other  operations 
equally  contributes  to  this  demand,  the  probability  that  none  of  these  operations  requires  R^  at 

time  X  is  given  by: 

D‘‘f{x)-D\(Rp,x)  V 
(1 - ^ - - - ) 


(2) 
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It  is  tempting  to  approximate  avaif^r‘^,^,t,t+du‘),  i.e.  the  probability  that  ^iik=^P 
available  to  O-  between  t  and  t+du\,  as  the  product  of  the  probabilities  that  Rp  will  be  available 
to  0\  on  each  one  of  the  du\  time  intervals  between  t  and  t+du\.  In  general,  this  approximation  is 
too  pessimistic.  It  assumes  that  the  operations  competing  with  0\  have  a  duration  equal  to  1,  i.e. 
that  any  of  these  operations  could  require  Rp  over  time  interval  [t,t  +  1[  without  requiring  it  over 
time  interval  [t+  1  ,x+2[  or  over  time  interval  [x- 1,  x[.  Instead,  because  operations  competing 
for  Rp  generally  require  several  contiguous  time  intervals,  a  better  approximation  can  be 
obtained  by  subdividing  the  calendar  of  that  resource  into  buckets  of  duration  AVG(du),  where 
AVG{du)  is  the  average  duration  of  the  operations  competing  for  r^k-Rp-  o.vail\{r\jj^,t,t+du^  is 

then  approximated  as  the  probability  that  0\  will  be  able  to  secure  the  time  buckets  that  it 

requires  to  fit  on  the  resource’s  calendar.  Using  Equation  (2),  this  can  be  approximated  as: 


avail\{Rp  ,t,t+ du^)  =  ( 1  “ 


du\ 

- ) 

AyG(n^(T)-l)  ’ 


(3) 


where  AVG(Z)“^^''(x)-Z)|(i?  ,x))  and  A7G(n  (x)-l)  are  respectively  the  average  of 

1  ^  ^  ^  I 

(x)-Z):(i?  ,x)  and  the  average  of  n  Jx) - 1  over  time  interval  [t,  t+du^[. 

Figure  13  depicts  reservation  survivabilities  for  the  three  operations  in  job  73,  the  job  to  which 
G3  belongs  (the  operation  selected  to  be  scheduled  in  the  initial  search  state).  The  shape  of  these 
survivability  curves  is  easily  interpreted  by  looking  at  Figures  7  and  11.  Consider  operation  0\. 
Figure  7  indicates  that  Gj  only  competes  with  one  other  operation  for  resource  R^^,  namely 
operation  Oy  Because  operation  0\  has  a  duration  du\=3  and  because  the  earliest  possible  start 
time  of  operation  Gj  is  st^=6,  operation  Gj  will  never  conflict  with  operation  G3  if  it  is 
scheduled  at  st\ =0,  1,  2,  or  3.  This  is  why  the  survivability  of  each  of  these  start  times  is  equal  to 
1.  For  start  times  5tj=4,5,  and  6  the  probability  of  conflicting  with  a  reservation  assigned  to  G3 
increases,  as  indicated  in  Figure  1 1  by  the  higher  aggregate  demand  for  resource  R^  between 
time  6  and  9  (the  only  times  where  a  conflict  between  the  two  operations  is  possible).  Since  the 
probability  of  such  a  conflict  remains  fairly  low  (i.e.  the  conflicts  involve  only  two  operations 
and  only  a  small  fraction  of  the  reservations  of  these  two  operations  conflict  with  each  other),  the 
survivabilities  of  start  times  5tj=4,5,  and  6  remain  fairly  close  to  1  (though  smaller  than  1). 
Operations  0\  and  G3  compete  with  more  operations  than  Gj.  Accordingly,  their  reservation 
survivabilities  are  smaller.  The  shape  of  the  survivability  curves  of  these  two  operations  can  be 
interpreted  using  similar,  though  slightly  more  complex  arguments. 
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Fig.  13  Survivability  measures  for  the  reservations  of  operations  in  job  j^,  the  job 
to  which  belongs  0\,  the  current  critical  operation. 

6.4.2.  Estimating  the  Probability  that  a  Job  Schedule  Survives  Contention 

A  good  reservation  p  for  a  critical  operation  is  not  just  one  that  is  likely  to  (locally)  survive 
contention  for  the  resources  it  requires.  It  should  also  leave  enough  room  to  other  unscheduled 
operations  in  the  same  job  (job  jj)  so  that  they  too  have  reservations  that  are  likely  to  survive 
resource  contention.  Accordingly,  our  value  ordering  heuristic  ranks  each  remaining  reservation 
(of  the  critical  operation)  by  estimating  the  number  of  job  schedules  compatible  with  this 
reservation  that  are  likely  to  survive  resource  contention  (in  short,  the  expected  number  of 
survivoble  schedules'").  When  some  operations  in  the  job  have  already  been  scheduled,  rather 
than  looking  at  the  entire  job,  it  is  sufficient  to  look  at  the  relaxation  comprised  of  all 
unscheduled  operations  that  can  be  reached  from  the  current  (critical)  operation  via  precedence 
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constraints  without  visiting  a  scheduled  operation. 

The  following  details  the  way  in  which  our  value  ordering  heuristic  approximates  the  number 
of  job  schedules  compatible  with  a  given  reservation  (for  the  critical  operation)  that  are  expected 
to  survive  resource  contention.  The  reader  who  is  not  interested  in  these  details  can  safely  jump 
to  Section  7  or  8. 

In  order  to  proceed,  a  few  notations  need  to  be  introduced: 

•  0\:  the  current  critical  operation  (i.e.  the  operation  selected  to  be  scheduled  next); 

•  p:  one  of  (9-’s  remaining  reservations; 

•  RELAX\  c  ok  the  set  of  operations  that  make  up  the  relaxation  used  by  our  value 
ordering  heuristic.  This  set  consists  of  0\  and  the  unscheduled  operations  that  can 
be  reached  from  0\  via  precedence  constraints  without  visiting  a  scheduled 
operation; 

•  goodjip):  the  goodness  of  assigning  p  to  C>|,  expressed  as  the  expected  number  of 
survivable  solutions  to  the  relaxation; 

•  comp\{p)\  the  set  of  solutions  to  the  relaxation  that  are  compatible  with  the 
assignment  of  p  to  0\ ; 

•  sol  e  comp\{p)\  a  solution  to  the  relaxation  that  is  compatible  with  the  assignment  of 

ptoOj; 

•  p  {&f^\sol) :  the  reservation  assigned  to  an  operation  e  RELAX^i  in  solution  sol. 


Assuming  that  the  probability  that  a  solution  sol  survives  resource  contention  can  be 
approximated  by  the  product  of  the  probabilities  that  each  reservation  p  {0[  \  sol)  in  sol  survives 
contention,  the  goodness  of  assigning  p  to  0\  is: 

good\ip)=  ^  n  surv[ip(0[\sol))  (4) 

sol  e  compfp)  g  REIA)/^ 

This  independence  assumption  is  equivalent  to  omitting  the  interactions  induced  by  precedence 
constraints  in  other  jobs.  Empirical  results  reported  in  Section  8  suggest  that  this  independence 
assumption  is  generally  acceptable.  Thanks  to  this  assumption,  the  only  reservation 
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survivabilities  that  need  to  be  computed  in  each  search  state  are  those  of  operations  in 
iJELAX;  c  OK 

Expression  (4)  can  be  rewritten  to  separate  the  survivability  of  reservation  p  from  that  of  other 
operations  in  REIAX\: 

good\(p)  =  surv^ip)  X  21  n  surv[(p(0[\sol))  (5) 

sol  e  compfp)  o[  e  RELAx\\{o\] 


This  can  be  further  rewritten  as: 

good‘.(p)  =  surv‘.(p)  X  compsurv'-ip)  (6) 

where  compsurv\{p)  is  the  number  of  solutions  compatible  with  the  assignment  of  p  to  0\  that  are 
expected  to  survive  contention: 

compsurv](p)  =  I ,  n  surv[(p(0[\sol)) 

sol  e  comp|(p)  o[  e  RELAx‘p{o\] 

Note  that,  in  fact,  compsurv\{p)  is  only  a  function  of  the  start  time  st\  allocated  to  O,  in 
reservation  p  an  can  therefore  be  written  as  compsurv]{t) 

In  tree-like  process  routings,  it  is  possible  to  evaluate  compsurv\{t)  for  all  the  possible  start 
times  t  of  0\  in  0(yik)  steps,  where  V;  <  is  the  number  of  operations  in  relaxation  RELAJ^-,  and 
k  the  mayimnm  number  of  possible  reservations  of  an  operation.  This  is  done  using  a  dynamic 
programming  procedure  described  in  Appendix  A.  This  technique  is  an  adaptation  of  a  procedure 
described  in  [Dechter  88].  The  complexity  of  Dechter’s  procedure  is  for  general  tree-like 

CSPs.  Here  we  have  further  reduced  this  complexity  to  (9(V/k)  by  taking  advantage  of  the 
linearity  of  precedence  constraints.  If  the  model  was  to  allow  for  other  temporal  constraints  such 
as  those  described  in  [Allen  83],  the  complexity  of  the  algorithm  would  be  OCv^k^).  For  non¬ 
tree-like  process  plans,  it  should  be  possible  to  remove  a  small  number  of  precedence  constraints 
(e.g.  precedence  constraints  that  are  not  on  a  critical  path)  to  transform  the  process  routing  into  a 
tree-like  one,  and  use  the  resulting  relaxation  to  compute  goodness  measures. 

In  the  example  discussed  earlier,  the  critical  operation  is  O^.  Since  no  operation  has  been 
scheduled  yet,  the  relaxation  used  by  the  heuristic  consists  of  all  three  operations  in  job  Figure 
14  displays  the  goodness  measures  computed  using  (6).  Start  time  5^3=6  for  instance  is  only 
compatible  with  one  solution  to  the  relaxation,  namely  a  solution  in  which  st2='i  and  5tj=0. 
Therefore,  the  goodness  of  this  start  time  is  given  by: 
gooJ(5t3=6)=.SMrv5(5ti=0)X5Mn;^(54=3)X'y«'^3(‘^4=6)-  On  the  other  hand,  start  time  st\=l  is 
compatible  with  three  solutions  to  the  relaxation,  one  with  3  and  jtj  =  0,  one  with  5^3  nnd 
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Reservation  Goodness  for  O3 


Fig.  14  Value  goodness  for  0\  expressed  as  the  number  of 
compatible  job  schedules  expected  to  survive  resource  contention. 

and  one  with  st\=A  and  5?^  =  1.  The  survivability  of  this  start  time  was  obtained  by  adding 
the  survivabilities  of  each  of  these  three  solutions. 

Start  time  5^3=  12  is  the  one  compatible  with  the  largest  number  of  survivable  solutions  to  the 
relaxation.  Hence  this  is  the  start  time  selected  by  the  value  ordering  heuristic.  By  assigning  this 
start  time  to  O3,  and  iteratively  using  the  variable  and  value  ordering  heuristics  that  were  just 
described,  the  search  procedure  easily  completes  the  schedule  without  backtracking.  This 
problem  is  relatively  easy,  and  is  also  solved  without  backtracking  by  Keng  and  Yun’s  heuristic. 

No  heuristic  is  perfect.  Although  our  value  ordering  heuristic  recommends  the  right  start  time, 
a  careful  analysis  reveals  for  instance  that  its  second  best  choice,  namely  5^3  =  11,  is  actually 
infeasible.  Notice  however  that,  in  the  absence  of  backtracking,  the  scheduler  does  not  need  to 
try  the  second  best  value  recommended  by  the  heuristic:  it  is  enough  for  the  first  value  to  work. 

In  Appendix  B,  we  describe  a  filtering  mechanism  used  in  our  value  ordering  heuristic  to 
further  refine  the  ranking  of  reservations.  We  refer  to  the  resulting  heuristic  as  the  FSS  value 
ordering  heuristic  -  FSS  stands  for  "Filtered  Survivable  Schedules". 
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7.  Overall  Complexity 

In  each  search  state,  the  worst-case  complexity  of  the  look-ahead  analysis  is  0{max{Nk,Hm)), 
where  N  is  the  number  of  unscheduled  operations  in  the  current  search  state,  k  the  maximum 
number  of  reservations  left  to  an  operation  in  that  state,  H  the  scheduling  horizon,  and  m  the 
number  of  resources  in  the  system.  In  general  0{Nk)  appears  to  be  the  dominant  factor.  In  the 
absence  of  backtracking  (i.e.  the  number  of  search  states  generated  by  the  system  is  equal  to  the 
number  of  operations  to  be  scheduled),  the  overall  complexity  of  the  approach  is  OiNOP  k), 
where  NOP  denotes  the  total  number  of  operations  to  be  scheduled.  Experimentation  with 
problems  of  different  sizes  suggests  that,  in  the  absence  of  backtracking,  this  is  the  true 
complexity  of  the  approach.  Clearly,  when  backtracking  occurs,  the  overall  complexity  of  the 
procedure  can  be  much  higher,  though  empirical  results  presented  in  Section  8  show  that  this  is 
not  often  the  case. 


34 


8.  Empirical  Evaluation 

This  section  reports  the  results  of  an  experimental  study  comparing  the  ORR  variable  ordering 
heuristic  and  FSS  value  ordering  heuristic  against  the  DSR  (Dynamic  Search  Rearrangement) 
variable  heuristic  (DSR)  [Bitner  75,  Haralick  80,  Purdom  83],  the  ABT  (Advised  Backtracking) 
value  ordering  [Dechter  88],  and  the  combination  of  variable  and  value  ordering  heuristics 
developed  by  Keng  and  Yun  [Keng  89]. 

8.1.  Design  of  the  Test  Data 

A  set  of  60  scheduling  problems  was  randomly  generated,  each  with  5  resources  and  10  jobs  of 
5  operations  each  (i.e.  a  total  of  50  operations  per  problem).  Each  job  had  a  linear  process 
routing  specifying  a  sequence  in  which  the  job  had  to  visit  each  one  of  the  five  resources.  This 
sequence  was  randomly  generated  for  each  job,  except  for  bottleneck  resources,  which  were  each 
visited  after  a  fixed  number  of  operations  (in  order  to  further  increase  resource  contention). 

Two  parameters  were  adjusted  to  cover  different  scheduling  conditions:  a  range  parameter, 
RG,  controlled  the  distribution  of  job  due  dates  and  release  dates,  and  a  bottleneck  parameter, 
BK,  controlled  the  number  of  major  bottleneck  resources.  Six  groups  of  ten  problems  were 
randomly  generated,  by  considering  three  different  values  of  the  range  parameter  and  two 
different  bottleneck  configurations.  The  value  of  a  third  parameter,  which  will  be  referred  to  as 
the  slack  parameter,  S,  had  to  be  adjusted  as  a  function  of  the  first  two  in  order  to  keep  demand 
for  bottleneck  resource(s)  close  to  100%  over  the  major  part  of  each  problem.  If  this  parameter 
had  been  fixed  while  the  other  parameters  were  allowed  to  change,  a  large  proportion  of  the 
problems  would  have  been  either  trivial  or  infeasible. 

The  three  parameters  were  set  as  follows: 

•  Range  Parameter  (RG):  this  parameter  controlled  the  release  date  and  due  date 
distributions  in  each  problem.  Due  dates  were  randomly  drawn  from  a  uniform 
distribution  (l+S)MU(l-RG,l),  where  U(a,b)  represents  a  uniform  probability 
distribution  between  a  and  b,  M  is  an  estimate  of  the  minimum  makespan  of  the 
problem,  and  S  is  the  slack  parameter,  which  is  defined  below  as  a  function  of  BK 
and  RG.  The  minimum  makespan  of  the  problem  was  estimated  as 

M={n-l)dMj^  ’  where  n  is  the  number  of  jobs,  m  the  number  of 

resources,  the  main  bottleneck  resource  (or  one  of  them  if  there  are  several) 

and  dUf^  denotes  the  average  duration  of  the  operations  requiring  resource  R,-.  This 
estimate  was  first  suggested  in  [Ow  85].  Similarly,  release  dates  were  randomly 
drawn  from  a  uniform  distribution  of  the  form:  (1  +  5)M  U(0,RG).  Three  values  of 
the  range  parameter  were  used  to  generate  problems:  RG=0.0,0.1 ,  and  0.2.  Due  to 
the  moderate  size  of  the  scheduling  problems  considered  here,  larger  values  of  RG 
quickly  tend  to  produce  less  resource  contention.  This  is  also  in  part  due  to  the  fact 
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that,  to  keep  from  generating  infeasible  problems,  we  increase  the  value  of  the  slack 
parameter,  S,  as  RG  becomes  larger,  as  detailed  below. 

•  Bottleneck  Parameter  (BK):  In  half  of  the  problems,  there  was  only  one  major 
bottleneck  {BK=1),  while  in  the  other  half  there  were  two  major  bottlenecks 
(BK=2). 


•  Slack  Parameter  (S):  For  problems  with  2  bottlenecks  or  jobs  with  different 
release  dates  and  due  dates,  the  time  span  of  each  problem  was  inflated  to  (1  +  5)M 
so  that  most  problems  remained  feasible.  The  slack  parameter  was  empirically  set 
to  5=0.1  x{BK-l)+RG.  While  ensuring  that  most  problems  remained  feasible, 
this  provided  for  close  to  100%  utilization  of  bottleneck  resources  over  the  major 
part  of  each  problem. 

Finally,  operation  durations  were  randomly  drawn  from  two  different  distributions,  depending 
on  whether  an  operation  required  a  bottleneck  resource  or  not.  Bottleneck  operations  had 
durations  randomly  drawn  from  a  uniform  distribution  f/(8,16)  whereas  non-bottleneck 
operations  had  their  durations  randomly  drawn  from  a  uniform  distribution  U(3,ll).  On  average, 
operations  in  these  problems  had  slightly  over  100  possible  start  times  (i.e.  values)  left  after 
application  of  the  consistency  enforcing  procedure  in  the  initial  search  state. 

8.2.  Comparison  With  Other  Heuristics 

Five  combinations  of  variable  and  value  ordering  heuristics  were  compared: 

•  DSR  &  ABT:  the  Dynamic  Search  Rearrangement  heuristic  [Bitner  75]  combined 
with  the  Advised  BackTracking  value  ordering  heuristic  [Dechter  88].  The  version 
of  ABT  used  in  these  experiments  was  one  based  on  the  same  predetermined  tree¬ 
like  relaxation  as  FSS,  namely  it  used  the  process  routing  to  which  the  current 
operation  belonged.  This  version  of  ABT  was  carefully  implemented  to  run  in 
0(V;k)  steps  in  each  search  state  (where  V;  is  the  number  of  operations  in  the  tree¬ 
like  relaxation  and  k  the  maximum  number  of  remaining  start  times  of  an  operation 
after  consistency  checking).  This  was  done  using  a  procedure  similar  to  the  one 
implemented  in  FSS.  Notice  that  an  implementation  of  ABT  using  MST  relaxations 
would  have  been  too  slow  to  be  competitive.  It  would  have  required  computing 
constraint  satisfiabilities  and  identifying  an  MST  relaxation  in  each  search  state. 
Additionally,  the  time  required  to  count  the  number  of  solutions  to  a  general  MST 
relaxation  would  have  been  (9(V;k^). 

•  DSR  &  FSS:  the  DSR  heuristic  combined  with  the  Filtered  Survivable  Schedules 
(FSS)  value  ordering  heuristic  (with  3>=2.5). 


•  ORR  &  AST.  the  Operation  Resource  Reliance  (ORR)  variable  ordering  heuristic 
together  with  the  ABT  value  ordering  heuristic. 
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•  ORR  &  FSS:  The  ORR  and  FSS  heuristics  (with  ^=2.5)  advocated  in  this  paper. 

•  SMU:  The  variable  and  value  ordering  heuristics  developed  by  Keng  and  Yun  at  the 
Southern  Methodist  University  [Keng  89]. 

All  combinations  of  variable  and  value  ordering  heuristics  were  run  in  a  modular  testbed  in 
which  all  common  functions  were  shared  (e.g.  consistency  enforcing  module,  backtracking 
module,  etc.),  and  unnecessary  functions  were  bypassed  whenever  possible  (e.g.  bypassing  the 
construction  of  demand  profiles  in  DSR&ABT).  All  functions  were  implemented  with  equal 
care. 

On  each  problem,  search  was  stopped  if  it  required  more  than  500  search  states.  The 
performance  of  each  combination  of  variable  and  value  ordering  heuristics  was  compared  along 
3  dimensions: 

1.  Search  efficiency:  the  ratio  of  the  number  of  operations  to  be  scheduled  over  the 
total  number  of  search  states  that  were  explored.  In  the  absence  of  backtracking, 
only  one  search  state  is  generated  for  each  operation,  and  hence  search  efficiency  is 
equal  to  1.  While  a  high  search  efficiency  is  not  necessarily  synonymous  with  a 
fast  procedure,  evaluation  of  heuristics  with  respect  to  search  efficiency  is 
important.  It  tells  us  if  a  heuristic  is  doing  a  good  job  at  focusing  search  on  critical 
variables  and  promising  values  for  these  variables.  In  particular,  we  want  to  make 
sure  that  the  probabilistic  framework  introduced  in  Section  6  is  doing  a  good  job  at 
capturing  key  constraint  interactions  that  are  not  well  accounted  for  in  generic  CSP 
heuristics.  This  metric  can  tell  us  if  this  is  indeed  the  case. 

2.  Number  of  experiments  solved  in  less  than  500  search  states  each.  When  a 
combination  of  variable  and  value  ordering  heuristics  cannot  solve  a  given 
experiment  in  less  than  500  search  states,  it  typically  needs  thousands  of  search 
states  to  reach  a  solution.  At  that  point,  it  does  not  make  sense  to  let  the  procedure 
continue,  as  it  will  not  return  a  solution  within  any  reasonable  amount  of  time. 

3.  Average  CPU  time  (in  seconds):  this  is  the  average  CPU  time  required  to 
successfully  schedule  a  problem.  When  a  solution  cannot  be  found  in  less  than  500 
search  states,  this  time  is  approximated  as  the  CPU  time  required  to  explore  500 
search  states.  All  CPU  times  were  obtained  on  a  DECstation  5000/200  running 
Knowledge  Craft  on  top  of  Allegro  Common  Lisp.  Experimentation  with  a  more 
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recent  version  of  our  system  written  in  C++  indicates  that  the  procedure  runs  about 
30  times  faster  in  this  language  (on  the  same  platform). 

The  results  are  summarized  in  Table  1.  They  indicate  that  DSR  is  generally  not  sufficient  to 
solve  realistic  job  shop  scheduling  problems.  Combined  with  ABT,  this  heuristic  was  only  able 
to  solve  29  problems  out  of  60  in  less  than  500  search  states  each.  Even  when  combined  with 
the  FSS  value  ordering  heuristic,  DSR  only  achieved  a  search  efficiency  of  58%,  and  failed  to 
solve  27  problems  out  of  60  in  less  than  500  search  states.  These  results  not  only  suggest  that  job 
shop  scheduling  requires  a  dynamic  variable  ordering  heuristic  They  also  indicate  that  the 
variable  ordering  heuristics  proposed  so  far  in  the  CSP  literature  are  often  too  shallow  for 
problems  such  as  job  shop  scheduling.  After  replacing  DSR  with  ORR  in  combination  with 
ABT,  search  efficiency  went  up  by  16%  and  1 1  additional  problems  were  solved  in  less  than  500 
search  states  each.  The  SMU  heuristic  achieved  a  higher  efficiency  of  72%  and  solved  43 
problems  out  of  60  in  less  than  500  states.  Even  this  heuristic  had  trouble  solving  many 
problems.  In  fact,  it  could  hardly  solve  more  problems  than  ORR&ABT.  ORR&FSS,  the 
variable  and  value  ordering  heuristics  advocated  in  this  paper,  yielded  an  impressive  86%  search 
efficiency,  and  solved  52  problems  out  of  60  in  less  than  500  search  states.  Among  the  52 
experiments  that  it  was  able  to  solve,  ORR&FSS  never  generated  more  than  78  search  states  and 
never  took  over  150  CPU  seconds  to  solve  a  problem.  This  heuristic  combination  also  achieved 
important  speedups  over  all  the  other  heuristics. 

8.3.  Recent  Developments  and  Additional  Results 

The  benchmark  problems  used  in  this  study  have  been  made  available  to  the  research 
community  at  large  through  an  anonymous  ftp  account  at  CMU  and  have  been  widely 
disseminated,  providing  for  the  first  time  a  common  set  of  problems  in  this  area.  A  high  point  in 
the  history  of  the  benchmark  was  reached  at  the  AAAI  Spring  Symposium  held  at  Stanford  in 
March  1992,  when  three  groups  of  researchers  simultaneously  announced  they  were  able  to 

efficiently  solve  all  60  problems,  using  three  different  approaches: 

1 .  A  bottleneck  partitioning  approach  developed  by  Muscettola  within  the  context  of 
his  HSTS  system,  in  which  precedence  constraints  are  imposed  between  subsets  of 
operations  contending  for  the  same  resource  [Muscettola  94].  Resource  contention 
is  approximated  via  Monte  Carlo  simulation.  If  the  procedure  fails  to  find  a 
feasible  solution,  it  restarts  from  scratch,  relying  on  the  stochasticity  of  its  Monte 
Carlo  simulation  to  produce  a  different  solution; 

2.  A  trial-and-error  approach  developed  by  Johnston  et  al.  within  the  context  of  the 
SPIKE  system.  This  approach  relies  on  a  collection  of  initialization  heuristics 
[Johnston  94].  The  schedule  produced  by  the  initialization  heuristics  often  violates 


[Sadeh  91],  we  also  reported  experiments  comparing  variations  of  our  ORR  heuristic  that  differed  in  the 
number  of  critical  operations  scheduled  at  once,  namely  less  dynamic  variations  of  ORR  where  two  or  more  critical 
operations  are  selected  at  once.  These  experiments  show  that  the  performance  of  the  variable  ordering  heuristic 
quickly  degrades  as  it  becomes  less  dynamic. 


Performance  of  Five  Heuristics 


DSR 

&ABT 

DSR 

&FSS 

ORR 

&ABT 

SMU 

ORR 

&FSS 

RG=0.2 

BK=1 

Search 

Efficiency 

0.72 

(0.42) 

0.82 

(0.38) 

0.96 

(0.06) 

1.00 

(0.00) 

0.96 

(0.07) 

Nb.  exp.  solved 

8 

8 

10 

10 

10 

CPU  seconds 

524 

(695.5) 

380 

(515) 

78.5 

(10.5) 

188 

(14) 

88.5 

(13) 

o 

II  II 

Search 

Efficiency 

0.49 

(0.40) 

0.73 

(0.43) 

0.54 

(0.39) 

0.79 

(0.38) 

0.99 

(0.02) 

Nb.  exp.  solved 

7 

7 

6 

8 

10 

CPU  seconds 

886.5 

(819) 

456.5 

(489) 

566.5 

(591.5) 

384.5 

(379.5) 

93 

(7.5) 

RG=0.1 

BK=1 

Search 

Efficiency 

0.60 

(0.44) 

0.82 

(0.38) 

0.79 

(0.36) 

0.64 

(0.46) 

0.78 

(0.36) 

Nb.  exp.  solved 

7 

8 

9 

6 

8 

CPU  seconds 

473.5 

(486.5) 

266 

(249) 

290 

(416) 

464.5 

(390.5) 

331.5 

(503.5) 

RG=0.1 

BK=2 

Search 

Efficiency 

0.22 

(0.27) 

0.46 

(0.46) 

0.31 

(0.37) 

0.71 

(0.42) 

0.87 

(0.29) 

Nb.  exp.  solved 

2 

4 

4 

7 

9 

CPU  seconds 

925 

(460) 

483 

(324) 

918 

(575) 

355 

(301.5) 

184 

(281) 

RG=0.0 

BK=1 

Search 

Efficiency 

0.28 

(0.38) 

0.32 

(0.38) 

0.53 

(0.44) 

0.46 

(0.46) 

0.73 

(0.43) 

Nb.  exp.  solved 

2 

3 

6 

4 

7 

CPU  seconds 

857 

(411) 

659 

(379) 

832 

(817) 

626 

(399.5) 

475 

(640.5) 

RG=0.0 

BK=2 

Search 

Efficiency 

0.31 

(0.33) 

0.37 

(0.43) 

0.46 

(0.40) 

0.75 

(0.41) 

0.82 

(0.38) 

Nb.  exp.  solved 

3 

3 

5 

8 

8 

CPU  seconds 

679.5 

(514) 

615 

(420) 

907 

(830) 

383.5 

(415) 

300.5 

(444) 

Overall 

Performance 

Search 

Efficiency 

0.44 

(0.41) 

0.58 

(0.45) 

0.60 

(0.41) 

0.72 

(0.41) 

0.86 

(0.31) 

Nb.  exp.  solved 

29 

33 

40 

43 

52 

CPU  seconds 

724.5 

(585.5) 

476.5 

(411.5) 

598.5 

(665.5) 

400 

(356.5) 

245.5 

(403.5) 

Table  I  Comparison  of  5  heuristics  over  6  sets  of  10  job  shop  problems. 
Standard  deviations  appear  between  parentheses. 
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one  or  more  constraints.  When  this  is  the  case,  it  is  passed  on  to  a  "Min-Conflict" 
heuristic  that  attempts  to  get  rid  of  conflicts  within  the  solution  (or  "repair"  the 
solution)  [Minton  92].  If  "Min-Conflict"  fails  to  produce  a  feasible  schedule 
within  a  prespecified  number  of  repair  cycles,  a  new  schedule  is  generated  by  the 
initialization  heuristics  and,  if  necessary,  passed  on  to  "Min-Conflict"  for  repair. 
The  specific  initialization  techniques  used  in  SPIKE  have  never  been  published. 
[Muscettola  94]  has  reported  that  "Min-Conflict"  by  itself  can  only  solve  about  24 
out  of  our  60  benchmark  problems.  This  suggests  that  the  ability  of  this  approach 
to  solve  all  60  problems  should  mainly  be  attributed  to  its  initialization  heuristics. 

3.  A  procedure  we  developed  that  combines  our  ORR&FSS  heuristics  with  intelligent 
backtracking  mechanisms  described  in  [Sadeh  92,  Sadeh  95]. 


■ - Without  Rough  Demand  Profiles  With  Rough  Demand  Profiles 


Fig.  15  Scale-up  experiments:  versions  with  and  without  rough  demand 
profiles.  Problem  sizes  are  the  number  of  operations  to  be  scheduled. 

CPU  times  are  on  a  DECstation  5000/200  running  C++. 

More  recently,  we  reimplemented  our  heuristics  in  C++.  Most  of  the  problems  can  be  solved  in 
3  to  4  CPU  seconds  on  a  DECstation  5000/200.  We  were  also  able  to  further  speed  up  the 
computation  of  demand  profiles,  using  simpler  "rough"  demand  profiles  to  identify  areas  of  high 
contention  over  which  the  more  detailed  demand  profiles  described  in  Section  6  are  then 
constructed.  The  rough  demand  profiles  are  obtained  by  evenly  spreading  the  demand  of  each 
unscheduled  operation  between  its  earliest  start  time  and  its  latest  finish  time.  Rough  demand 
profiles  can  easily  be  updated  from  one  search  state  to  the  next  and  can  significantly  reduce 
computation  time  by  focusing  the  construction  of  more  detailed  demand  profiles  over  those  areas 
of  highest  contention.  Using  these  rough  demand  profiles,  the  CPU  time  required  to  solve  our  60 
benchmark  problems  fell  between  1 .5  and  2.5  CPU  seconds  on  a  DECstation5000/200,  showing 
that  these  heuristics  remain  quite  competitive  in  comparison  with  more  recent  techniques 
proposed  for  the  job  shop  CSP  [Smith&Cheng  93,  Liu  94,  Nuijten  94].  The  speedups  obtained 
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using  rough  demand  profiles  also  become  more  significant  on  larger  problems,  as  illustrated  in 
Figure  15.  Problems  with  up  to  several  thousand  operations  have  been  solved  by  the  procedure 
with  consistently  low  backtracking. 


% 
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9.  Summary  and  Concluding  Remarks 

In  this  paper,  we  studied  a  variation  of  the  job  shop  scheduling  problem  in  which  operations 
have  to  be  performed  within  one  or  several  non-relaxable  time  windows.  We  refer  to  this 
problem  as  the  job  shop  CSP.  Examples  of  this  formulation  of  the  job  shop  scheduling  problem 
can  be  found  in  the  factory  scheduling  domain  when  some  operations  have  to  be  performed 
within  one  or  several  shifts.  Other  examples  include  spacecraft  mission  scheduling  problems 
where  activities  need  to  be  scheduled  within  time  windows  imposed  by  various  astronomical 
events  (e.g.  [Muscettola  94]).  This  formulation  is  also  representative  of  a  number  of  rescheduling 
simations  where  one  needs  to  revise  a  schedule  subject  to  hard  constraints  imposed  by  other 
operations  whose  schedule  we  cannot  or  would  rather  not  modify.  More  generally,  the  job  shop 
CSP  formulation  can  be  used  to  model  any  scheduling  problem  with  hard  deadlines.  The  job 
shop  CSP  cannot  be  solved  with  traditional  scheduling  techniques  such  as  priority  dispatch  rules 
or  similar  one-pass  scheduling  techniques'^  [French  82,  Sadeh  91,  Morton  93]  .  Traditional 
Mixed  Integer  Programming  techniques  have  so  far  been  overwhelmed  by  the  combinatorial 
number  of  binary  variables  required  to  account  for  the  limited  resource  capacities  in  this  type  of 
problems  [Nemhauser  88].  Our  work,  which,  along  with  that  of  Keng  and  Yun  [Keng  89],  was 
the  first  one  to  apply  the  CSP  problem  solving  paradigm  to  this  class  of  problems,  demonstrates 
that  this  paradigm  provides  a  promising  alternative  to  traditional  scheduling  approaches.  Our 
approach  relies  on  a  depth-first  backtrack  search  procedure  that  combines  consistency  enforcing 
mechanisms  with  a  probabilistic  look-ahead  analysis  to  decide  which  operation  to  schedule  next 
(variable  ordering)  and  which  reservation  to  assign  to  each  operation  (reservation  ordering). 

In  the  first  part  of  the  paper,  we  reviewed  a  number  of  popular  variable  and  value  ordering 
heuristics  proposed  in  the  CSP  literature,  both  generic  heuristics  that  had  been  reported  to 
perform  particularly  well  on  other  CSPs  as  well  as  Keng  and  Yun’s  scheduling  heuristics  [Keng 
89].  We  showed  that  these  heuristics  often  fail  to  adequately  account  for  the  tightness  of 
constraints  and/or  for  the  interactions  induced  by  the  high  connectivity  of  the  constraint  graphs 
characteristic  of  job  shop  CSPs.  In  the  second  part  of  this  article,  we  introduced  a  new 
probabilistic  model  of  the  search  space  that  allows  us  to  estimate  the  reliance  of  a  variable  (i.e. 
an  operation)  on  the  availability  of  a  value  (i.e.  a  reservation),  and  the  degree  of  contention 
among  uninstantiated  variables  for  the  assignment  of  conflicting  values  (i.e.  contention  among 
unscheduled  operations  for  the  allocation  of  a  resource  over  some  time  interval).  Based  on  this 
probabilistic  model,  new  variable  and  value  ordering  heuristics  were  defined: 

1.  The  "Operation  Resource  Reliance"  (ORR)  variable  ordering  heuristic  selects  the 
operation  that  relies  most  on  the  most  contended  resource/time  interval,  and 

2.  The  "Filtered  Survivable  Schedules"  (FSS)  value  ordering  heuristic  assigns  to  that 


I'See  [Cheng  95]  for  experiments  applying  priority  dispatch  rules  to  our  set  of  60  benchmark  problems. 
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operation  the  reservation  expected  to  be  compatible  with  the  largest  number  of 
survivable  job  schedules,  i.e.  job  schedules  that  are  expected  to  survive  resource 
contention. 

Experimental  results  show  that  this  pair  of  heuristics  can  efficiently  solve  a  number  of  job  shop 
CSPs  that  could  not  be  efficiently  solved  by  prior  CSP  heuristics  (both  generic  CSP  heuristics 
and  specialized  heuristics  developed  by  Keng  and  Yun).  The  results  indicate  that  the  ORR  and 
FSS  heuristics  not  only  yield  significant  increases  in  search  efficiency  but  also  achieve  important 
reductions  in  search  time.  A  broader  set  of  probabilistic  metrics  to  help  guide  variable  and  value 
ordering  decisions,  which  we  refer  to  as  textures,  has  also  been  described  in  [Fox  89]. 

The  estimates  of  resource  contention  used  in  the  ORR  and  FSS  heuristics  are  based  on  several 
independence  assumptions.  More  sophisticated  versions  of  these  heuristics  have  also  been 
implemented,  which  attempt  to  better  account  for  different  dependencies,  some  using  more 
complex  analytical  models  [Sadeh  88,  Sadeh  89a,  Sadeh  90]  others  relying  on  Monte  Carlo 
simulations  [Sadeh  89b].  The  improvements  in  search  efficiency  generally  achieved  by  these 
more  sophisticated  versions  do  not  seem  to  justify  their  heavier  computational  requirements. 

While  our  ORR  and  FSS  heuristics  were  developed  for  the  job  shop  CSP,  the  probabilistic 
measures  of  reliance  and  contention  that  were  described  can  be  used  in  any  resource  allocation 
problem,  and,  in  fact,  any  CSP  with  disequality  constraints  (i.e.  constraints  preventing  two 
variables  from  being  assigned  the  same  value),  since  these  problems  can  be  formulated  as 
resource  allocation  problems.  For  instance,  the  N-queens  problem  [Kraitchick42,  Yaglom64, 
Abramson89]  often  used  to  evaluate  CSP  techniques  can  be  formulated  as  a  resource  allocation 
problem  in  which  each  queen/row  is  a  task  and  each  column  is  a  resource^^. 

In  fact,  the  lessons  learned  from  this  work  go  beyond  job  shop  scheduling  and  CSPs  with 
disequality  constraints.  Fundamental  weaknesses  of  generic  variable  and  value  ordering 
heuristics  often  praised  in  the  CSP  literature  have  been  identified.  Variable  ordering  heuristics 
like  DSR  count  the  number  of  values  left  to  each  variable  but  do  not  account  for  the  chances  that 
these  values  remain  available  as  a  solution  is  constructed.  Variable  ordering  heuristics  like  MW 
or  MC  count  the  number  of  constraints  incident  to  a  variable  but  do  not  account  for  the  tightness 
of  these  constraints.  Value  ordering  heuristics  like  ABT  assume  that  the  CSP  admits  a  tight  tree¬ 
like  relaxation.  The  probabilistic  model  of  the  search  space  introduced  in  this  paper  aims  at 
providing  a  framework  in  which  more  sophisticated  approximations  of  variable  criticality  and 
value  goodness  can  be  defined.  For  instance,  within  this  framework,  our  ORR  and  FSS 
heuristics  can  base  their  decisions  on  measures  of  resource  contention  that  account  for  entire 
cliques  of  capacity  constraints  rather  than  tree-like  relaxations  of  these  cliques. 


^^Constraints  representing  the  ability  of  queens  to  attack  each  other  along  diagonals  can  be  represented  as 
constraints  further  restricting  admissible  resource  assignments  [Keng  89]. 
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Finally,  while  our  work  shows  that  the  CSP  problem  solving  paradigm  does  scale  up  to 
complex  large-scale  domains  such  as  the  job  shop  scheduling  CSP,  it  also  suggests  that 
benchmark  problems  considered  in  earlier  CSP  studies  are  not  representative  of  this  and 
probably  other  classes  of  complex  CSPs.  We  hope  that  this  research  will  prompt  others  in  the 
field  to  revisit  earher  studies  and  look  for  more  challenging  problems  on  which  to  evaluate  their 
techniques. 
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Appendix  A.  Counting  the  Number  of  Survivable  Schedules 

This  appendix  describes  a  dynamic  programming  procedure  that  efficiently  counts  the  number 
of  survivable  job  schedules  (or  more  generally  the  number  of  survivable  solutions  to  the 
relaxation  defined  in  Section  6.4  for  the  FSS  value  ordering  heuristic)  that  are  compatible  with 
the  assignment  of  a  reservation  p  to  the  current  critical  operation  o\.  This  number  was  referred 
to  as  compsurv\{t),  where  t  is  the  start  time  allocated  to  0\  in  reservation  p.  The  procedure 
presented  here  is  a  variation  of  a  similar  method  developed  by  Dechter  and  Pearl  for  the  ABT 
value  ordering  heuristic  [Dechter  88]  (see  also  [Pearl  88]).  While  a  direct  generalization  of 
Dechter  and  Pearl’s  procedure  would  have  an  Oiyik^)  complexity  (where  is  the  number  of 
operations  in  the  relaxation  used  by  the  FSS  value  ordering  heuristic,  and  k  the  maximum 
number  of  possible  reservations  of  an  operation  in  that  relaxation),  the  procedure  described  here 
takes  advantage  of  the  linearity  of  precedence  constraints  to  reduce  this  complexity  to  (?(v^k). 


Fig.  16  A  tree-like  process  routing,  organized  with  the  current  critical  operation  as 
its  root.  Arrows  represent  precedence  constraints. 

Figure  16  represents  a  prototypical  tree-like  process  routing,  which  has  been  reorganized  with 
the  current  critical  operation  as  the  root  of  the  tree.  The  arrows  represent  precedence  constraints 
between  operations  in  the  process  routing.  The  children  of  the  critical  operation  0\  in  the  tree  are 
those  operations  that  are  directly  connected  to  0\  by  a  precedence  constraint,  the  grandchildren 
the  operations  directly  connected  to  these  operations  by  precedence  constraints,  etc. 

All  the  computations  presented  in  this  appendix  refer  to  a  single  search  state,  in  which 
consistency  checking  has  already  been  performed.  The  notations  are  those  used  in  Section  6.4. 
A  few  extra  notations  need  to  be  defined: 

•  5'MrVp(t)  =  Xp  e  where  G  is  the  set  of  remaining  reservations  of  with 

stl=t; 
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•  a‘ :  the  direct  children  of  0[  that  are  after  0‘  in  the  process  routing; 

p  P  y 

•  pj,:  the  direct  children  of  O'  that  are  before  Oj,  in  the  process  routing; 

•  A:  the  time  granularity  of  the  problem.  In  Section  6.4,  it  was  assumed  that  A=  1  (i.e. 
that  all  start  times  and  end  times  have  to  be  integers).  For  the  sake  of  clarity,  the 
formulas  presented  in  this  appendix  account  explicitly  for  A. 

In  tree-like  process  routings,  each  operation  is  the  unique  link  between  otherwise  disjoint 
sets  of  operations,  that  each  correspond  to  one  of  its  children.  Each  of  these  sets  contains  exactly 
one  child  of  operation  and  defines  a  subproblem  that  only  interacts  with  the  other 
subproblems  via  operation  O^.  Accordingly, 

•  For  each  Oj  e  p^,  we  define  BEP^p)  as  the  number  of  survivable  solutions  to  the 
subproblem  defined  by  operation  Oj  and  its  descendants  that  are  compatible  with  the 
assignment  of  si^ = r  to  (9^; 

•  For  each  0[  e  a^,  we  define  Apf^t)  as  the  number  of  survivable  solutions  to  the 
subproblem  defined  by  operation  0[  and  its  descendants  that  are  compatible  with  the 
assignment  of  to  (9^; 

Given  that  operation  0\  is  the  only  link  between  the  subproblems  defined  by  each  one  of  its 
children,  we  have; 

compsurv\{f)=  BEpp)x  AF'fpt) 

/  I 

je  P;  *6  a,. 

Notice  that  this  formula  also  relies  on  an  independence  assumption  made  in  Section  6.4:  the 
probability  that  a  solution  to  the  relaxation  survives  contention  is  assumed  to  be  given  by  the 
product  of  the  probabilities  that  each  one  of  the  reservation  assignments  in  that  solution  survives 
contention. 

BEP  (t)  is  obtained  by  adding  all  the  subproblem  solutions  compatible  with  the  precedence 
constraint  stj + duj  <  t: 

BET‘,p)=  X  [s«rv'(T)  X  JJ 

z<t-duj  peflj  qeaj 

Similarly  for  AFp^t),  we  have: 

AF'f.p)=  ^  [surv‘p:)x  5EF[^(t)x 

x>t+du-  uea^^ 
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We  can  speed  up  the  computation  of  this  recurrence  using  partial  sums: 

BEI^^p)=BEF^^p-^)+[surv]{t-du^)x  BEE^-Jt-du^)^  J]  AF'fjJd-du)'\ 

pspj  ?eaj 

AFf^Jd)=AFJ^^J^{t+^)  +  [surv[{t+dJ)^  H  BEF^^/t+dui)  x  ]][  AF7{ 

5  e  «  e 

The  recurrence  is  initialized  with: 

BEF’jes/j- A)=0 

AFJ^i^/lst[+A)=0 

and  uses  the  convention: 

n=i 

0 

In  order  to  compute  compsurv\  (t)  for  all  remaining  start  times  of  the  critical  operation  O-,  the 
system  starts  by  computing  all  BEF^jJd)  or  all  AF'fj  Jf)  at  the  leaf  operations  in  the  tree  depicted 
in  Figure  16.  The  procedure  then  moves  up  in  the  tree  by  combining  at  each  level  the  BEF^-p) 
and  AFfjp)  computed  at  the  previous  level.  At  each  operation  in  the  tree,  the  procedure 
computes  at  most  X  BEF^jp)  expressions  if  is  before  (/j,  its  parent  operation,  or  X  AF'fj  p) 
expressions,  if  (9^  is  after  Oj  (where  X  is  the  maximum  number  of  possible  start  times  of  an 
operation).  Each  such  computation  involves  2  multiplications  and  1  addition.  Hence,  if  V;  is  the 
number  of  operations  in  the  relaxation  used  by  the  FSS  value  ordering  heuristic,  computing  all 
compsurvp)  can  be  done  in  0(yiX)  elementary  computations.  Computing 
^Mrv^(r)=Xps  possible  start  times  of  all  the  operations  in  the  relaxation 

requires  however  Oiv^k)  steps  where  k  is  the  maximum  number  of  reservations  left  to  an 
operation  1^.  Hence  the  overall  complexity  of  the  procedure  is  also  Oiyik). 


^^The  real  complexity  is  actually  0{Vikdu),  where  du  is  the  duration  of  the  longest  operation  in  the  relaxation. 
This  duration  is  assumed  to  be  bounded  by  a  constant. 
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Appendix  B.  Value  Ordering  Filter 

The  following  describes  a  filtering  mechanism  used  to  refine  the  ranking  of  reservations  in  our 
FSS  value  ordering  heuristic. 

For  some  reservations  p,  compsurv^ip)  can  become  very  large  and  have  too  much  influence  in 
(6)  compared  to  surv\ip).  Consider  the  following  two  reservations  pj  and  ^2- 

•  pj:  comp5Mrvj (Pj)=  1000  and surv\(f)i)=0.5 

•  P2-  compsurv\ (P2) = 200  and  surv\ (P2)  =  1 .0 

Ideally,  a  good  value  ordering  heuristic  should  recognize  that  reservation  p2  is  better  than 
reservation  P2,  despite  the  fact  that,  according  to  Equation  (6)  g<3(9<i,(Pj)=500  is  larger  than 
good.ip2)=^0^-  Indeed,  in  this  example,  it  does  not  really  matter  whether  compsury\ip)  equals 
200  or  1000:  in  either  case  there  will  certainly  be  enough  compatible  schedules.  Instead,  the 
factor  that  really  matters  here  is  the  survivability  of  the  reservation  itself  (i.e.  locally).  In  the 
experiments  reported  at  the  end  of  this  paper,  this  problem  was  handled  by  filtering  the  number 
of  survivable  solutions  compatible  with  a  reservation  p,  compsurv‘.(p).  Instead  of  relying  on 
Equation  (6),  our  value  ordering  heuristic  measures  reservation  goodness  according  to  the 
following  revised  formula: 

gooz?' (p)  =  surv\ (p)  X  MIN(0^r^ ,  compsurv\  (p))  (2) 

where  MIN  denotes  the  minimum  function  and  <I>  is  a  parameter  of  the  system  that  is 
empirically  adjusted.  By  using  a  filter  of  the  form  the  heuristic  attempts  to  ensure  that,  on 

the  average,  each  one  of  the  —  1  other  operations  in  the  relaxation  has  O  survivable 
reservations^"^. 


more  sophisticated  way  of  filtering  compsurv\{p)  would  involve  filtering  the  number  of  compatible 
reservations  of  each  operation  in  the  relaxation.  This  would  ensure  that  each  one  of  the  operations  in  the  relaxation 
has  enough  compatible  reservations.  In  general,  because  the  critical  operation  is  also  the  one  in  the  relaxation  whose 
reservations  are  the  least  survivable,  a  single  filter  for  all  the  other  operations  in  the  relaxation  seems  sufficient. 


References 


[Allen  83] 

[Baker  74] 

[Bitner  75] 

[Cheng  95] 

[Davis  87] 

[Dechter  88] 

[Dechter  89a] 

[Dechter  89b] 

[Dechter  94] 

[Fox  87] 

[Fox  89] 

[French  82] 


J. RAllen. 

Maintaining  Knowledge  about  Temporal  Intervals. 

Communications  of  the  ACM  26(1 1):832-843,  1983. 

K. R.  Baker. 

Introduction  to  Sequencing  and  Scheduling. 

Wiley,  1974. 

J.R.  Bitner  and  E.M.  Reingold. 

Backtrack  Programming  Techniques. 

Communications  of  the  ACM  18(ll):651-655,  1975. 

Cheng-Chung  Cheng. 

Scheduling  by  Precedence  Constraints  Posting. 

PhD  thesis.  Graduate  School  of  Industrial  Administration  and  the  Robotics 
Institute,  Carnegie  Mellon  University,  1995. 

Ernest  Davis. 

Constraint  Propagation  with  Interval  Labels. 

Artificial  Intelligence  32:281-331, 1987. 

Rina  Dechter  and  Judea  Pearl. 

Network-Based  Heuristics  for  Constraint  Satisfaction  Problems. 

Artificial  Intelligence  34(1):  1-38, 1988. 

Rina  Dechter  and  Itay  Meiri. 

Experimental  Evaluation  of  Preprocessing  Techniques  in  Constraint 
Satisfaction  Problems. 

In  Proceedings  of  the  Eleventh  International  Joint  Conference  on  Artificial 
Intelligence,  pages  211-211 .  1989. 

Rina  Dechter,  Itay  Meiri,  and  Judea  Pearl. 

Temporal  Constraint  Networks. 

In  Proceedings  of  the  First  International  Conference  on  Principles  of 
Knowledge  Representation  and  Reasoning.  1989. 

Rina  Dechter  and  Itay  Meiri. 

Experimental  Evaluation  of  Preprocessing  Algorithms  for  Constraint 
Satisfaction  Problems. 

Artificial  Intelligence  68(2):21 1-241,  1994. 

Mark  S.  Fox. 

Constraint-Directed  Search:  A  Case  Study  of  Job-Shop  Scheduling. 

Morgan  Kaufmann  Publishers,  Inc.,  1987. 

Mark  S.  Fox,  Norman  Sadeh,  and  Can  Baykan. 

Constrained  Heuristic  Search. 

In  Proceedings  of  the  Eleventh  International  Joint  Conference  on  Artificial 
Intelligence,  pages  309-315.  1989. 

S.  French. 

Sequencing  and  Scheduling:  An  Introduction  to  the  Mathematics  of  the 
Job-Shop. 

Wiley,  1982. 


[Freuder  82] 


[Garey  79] 


[Ginsberg  90] 


[Golomb  65] 


[Haralick  80] 


[Johnson  74] 


[Johnston  94] 


[Keng  89] 


[LePape  87] 


[Liu  94] 


[Mackworth  85] 


E.C.  Freuder. 

A  Sufficient  Condition  for  Backtrack-free  Search. 

Journal  of  the  ACM  29{l):24-32, 1982. 

M.R.  Garey  and  D.S.  Johnson. 

Computers  and  Intractability:  A  Guide  to  the  Theory  of  NP-Completeness. 
Freeman  and  Co.,  1979. 

Matthew  L.  Ginsberg,  Michael  Frank,  Michael  P.  Halpin,  and  Mark 
C.  Torrance. 

Search  Lessons  Learned  from  Crossword  Puzzle. 

In  Proceedings  of  the  Eighth  National  Conference  on  Artificial  Intelligence, 
pages  210-215.  1990. 

Solomon  W.  Golomb  and  Leonard  D.  Baumert. 

Backtrack  Programming. 

Journal  of  the  Association  for  Computing  Machinery  12(4):516-524,  1965. 
Robert  M.  Haralick  and  Gordon  L.  Elliott. 

Increasing  Tree  Search  Efficiency  for  Constraint  Satisfaction  Problems. 
Artificial  Intelligence  14(3);263-313,  1980. 

L.A.  Johnson  and  D.C.  Montgomery. 

Operations  Research  in  Production  Planning,  Scheduling,  and  Inventory 
Control. 

Wiley,  1974. 

Mark  D.  Johnston  and  Steven  Minton. 

Analyzing  a  Heuristic  Strategy  for  Constraint  Satisfaction  and  Scheduling. 
Intelligent  Scheduling. 

In  Mark  Fox  and  Monte  Zweben, 

Morgan  Kaufmann  Publishers,  1994,  pages  257-289,  Chapter  9. 

Naiping  Keng  and  David  Y.Y.  Yun. 

A  Planning/Scheduling  Methodology  for  the  Constrained  Resource  Problem. 
In  Proceedings  of  the  Eleventh  International  Joint  Conference  on  Artificial 
Intelligence,  pages  998-1003.  1989. 

Claude  Le  Pape  and  Stephen  F.  Smith. 

Management  of  Temporal  Constraints  for  Factory  Scheduling. 

Technical  Report,  The  Robotics  Institute,  Carnegie  Mellon  University, 
Pittsburgh,  PA  15213, 1987. 

Also  appeared  in  Proc.  Working  Conference  on  Temporal  Aspects  in 
Information  Systems,  Sponsored  by  AFCET  and  IFIP  Technical 
Committee  TC8,  North  Holland  Publishers,  Paris,  France,  May  1987. 

JyiShane  Liu  and  Katia  Sycara. 

Collective  Problem  Solving  Through  Coordination  in  a  Society  of  Reactive 
Agents. 

Technical  Report  CMU-RI-TR-94-23,  The  Robotics  Institute,  Carnegie 
Mellon  University,  Pittsburgh,  PA  15213,  1994. 

A.K.  Mackworth  and  E.C.  Freuder. 

The  Complexity  of  some  Polynomial  Network  Consistency  Algorithms  for 
Constraint  Satisfaction  Problems. 

Artificial  Intelligence  25(l):65-74,  1985. 


50 


[McGregor  79]  J.J.  McGregor. 

Relational  Consistency  Algorithms  and  their  Applications  in  Finding 
Subgraph  and  Graph  Isomorphisms. 

Information  Sciences  19(3):229-250,  1979. 

[Minton  92]  Steven  Minton,  Mark  D.  Johnston,  Andrew  B.  Philips  and  Philip  Laird. 

Minimizing  Conflicts:  A  Heuristic  Repair  Method  for  Constraint  Satisfaction 
and  Scheduling  Problems. 

Artificial  Intelligence  58:161-205,  December,  1992. 

[Morton  93]  Morton,  Thomas  E.  and  David  W.Pentico. 

Heuristic  Scheduling  Systems. 

Wiley  Series  in  Engineering  and  Technology  Management,  1993. 

[Muscettola  87]  Nicola  Muscettola,  and  Stephen  Smith. 

A  Probabilistic  Framework  for  Resource-Constrained  Muti-Agent  Planning. 

In  Proceedings  of  the  Tenth  International  Conference  on  Artificial 
Intelligence,  pages  1063-1066.  1987. 

[Muscettola  94]  Nicola  Muscettola. 

HSTS:  Integrating  Planning  and  Scheduling. 

Intelligent  Scheduling. 

In  Mark  Fox  and  Monte  Zweben, 

Morgan  Kaufmann  Publishers,  1994,  pages  169-212,  Chapter  6. 

[Nadel  86]  B.A.  Nadel. 

Theory-based  Search-order  Selection  for  Constraint  Satisfaction  Problems. 
Technical  Report  DCS-TR-183,  Department  of  Computer  Science,  Laboratory 
for  Computer  Research,  Rutgers  University,  New  Brunswick,  NJ  08903, 
1986. 

[Nadel  88]  Bernard  Nadel. 

Tree  Search  and  Arc  Consistency  in  Constraint  Satisfaction  Algorithms. 
Search  in  Articial  Intelligence. 

In  L.  Kanal  and  V.  Kumar, 

Springer-Verlag,  1988. 

[Navinchandra  90] 

D.  Navinchandra. 

Exploration  and  Innovation  in  Design. 

Springer  Verlag,  1990. 

[Nemhauser  88]  G.L.  Nemhauser  and  L.A.  Wolsey. 

Integer  and  Combinatorial  Optimization. 

Wiley,  1988. 

[Nuijten  94]  Wilhelmus  P.M.  Nuijten. 

Time  and  Resource  Constrained  Scheduling. 

PhD  thesis,  Technische  Universiteit  Eindhoven,  December,  1994. 

[Ow  85]  Peng  Si  Ow. 

Focused  Scheduling  in  Proportionate  Flowshops. 

Management  Science  3 1(7): 852-869,  1985. 

[Pearl  84]  Judea  Pearl. 

Heuristics:  Intelligent  Search  Strategies  for  Computer  Problem  Solving. 
Addison-Wesley,  1984. 


51 


[Pearl  88] 

[Purdom  83] 

[Sadeh  88] 

[Sadeh  89a] 

[Sadeh  89b] 

[Sadeh  89c] 

[Sadeh  90] 

[Sadeh  91] 

[Sadeh  92] 

[Sadeh  94] 


Judea  Pearl. 

Probabilistic  Reasoning  in  Intelligent  Systems:  Networks  of  Plausible 
Inference. 

Morgan  Kaufmann,  1988. 

Paul  W.  Purdom,  Jr. 

Search  Rearrangement  Backtracking  and  Polynomial  Average  Time. 

Artificial  Intelligence  21:117-133,  1983. 

N.  Sadeh  and  M.S.  Fox. 

Preference  Propagation  in  Temporal/Capacity  Constraint  Graphs. 

Technical  Report  CMU-CS-88-193,  Computer  Science  Department,  Carnegie 
Mellon  University,  Pittsburgh,  PA  15213, 1988. 

Also  appears  as  Robotics  Institute  technical  report  CMU-RI-TR-89-2. 

N.  Sadeh  and  M.S.  Fox. 

Focus  of  Attention  in  an  Activity-based  Scheduler. 

In  Proceedings  of  the  NASA  Conference  on  Space  Telerobotics.  January, 
1989. 

N.  Sadeh  and  M.S.  Fox. 

CORTES:  An  Exploration  into  Micro-Opportunistic  Job-Shop  Scheduling. 

In  Workshop  on  Manufacturing  Production  Scheduling.  IJCAI89  -  Detroit, 
1989. 

Norman  Sadeh. 

Look-ahead  Techniques  for  Activity-based  Job-shop  Scheduling. 

1989 

Thesis  Proposal. 

Norman  Sadeh,  and  Mark  S.  Fox. 

Variable  and  Value  Ordering  Heuristics  for  Activity-based  Job-shop 
Scheduling. 

In  Proceedings  of  the  Fourth  International  Conference  on  Expert  Systems  in 
Production  and  Operations  Management,  Hilton  Head  Island,  S.C.,  pages 
134-144.  1990. 

Norman  Sadeh. 

Look-ahead  Techniques  for  Micro-opportunistic  Job  Shop  Scheduling. 

PhD  thesis.  School  of  Computer  Science,  Carnegie  Mellon  University,  March, 
1991. 

Norman  Sadeh,  Katia  Sycara,  and  Yalin  Xiong. 

Backtracking  Techniques  for  Hard  Scheduling  Problems. 

Technical  Report  CMU-RI-TR-92-06,  The  Robotics  Institute,  Carnegie 
Mellon  University,  Pittsburgh,  PA  15213, 1992. 

An  improved  version  of  this  paper  will  appear  in  an  Artificial  Intelligence 
Journal’s  special  issue  on  Planning  and  Scheduling. 

Norman  Sadeh. 

Micro-Opportunistic  Scheduling:  The  MICRO-BOSS  Factory  Scheduler. 
Intelligent  Scheduling. 

In  Mark  Fox  and  Monte  Zweben, 

Morgan  Kaufmann  Publishers,  1994,  pages  99-135,  Chapter  4. 


52 


[Sadeh  95]  Norman  Sadeh,  Katia  Sycara,  and  Yalin  Xiong. 

Backtracking  Techniques  for  the  Job  Shop  Scheduling  Constraint  Satisfaction 
Problem. 

Artificial  Intelligence  ,  1995. 

To  appear  in  Special  Issue  on  Planning  and  Scheduling.  Also  available  as 
CMU  technical  report  CMU-RI-TR-94-31.  An  earlier  version  of  this  paper 
also  appeared  as  CMU  technical  report  CMU-RI-TR-92-06. 

[Smith&Cheng  93] 

Smith,  S.F.  and  Cheng,  C. 

Slack-Based  Heuristics  for  Constraint  Satisfaction  Scheduling. 

In  Proceedings  of  the  Eleventh  National  Conference  on  Artificial  Intelligence. 
Washington,  DC,  1993. 

[Tarjan  83]  Robert  Endre  Tarjan. 

Minimum  Spanning  Trees. 

CBMS-NSF  Regional  Conference  Series  in  Applied  Mathematics.  Number 
AA'.Data  Structures  and  Network  Algorithms. 

Society  for  Industrial  and  Applied  Mathematics,  1983,  Chapter  6. 

[VanHenteryck  92] 

Pascal  Van  Hentenryck,  Helmut  Simonis,  and  Mehmet  Dincbas. 

Constraint  Satisfaction  Using  Constraint  Logic  Programming. 

Artificial  Intelligence  58(1-3):  113-159,  1992. 

[Walker  60]  R.J.  Walker. 

An  Enumerative  Technique  for  a  Class  of  Combinatorial  Problems. 
Combinatorial  Analysis,  Proc.  Sympos.  Appl.  Math. 

In  R.  Bellman  and  M.  Hall, 

American  Mathematical  Society,  Rhode  Island,  1960,  pages  91-94,  Chapter  7. 

[Zabih  88]  Ramin  Zabih  and  David  McAllester. 

A  Rearrangement  Search  Strategy  for  Determining  Propositional 
Satisfiability. 

In  Proceedings  of  the  Seventh  National  Conference  on  Artificial  Intelligence, 
pages  155-160.  1988. 

[Zweben  94]  Monte  Zweben,  Brian  Daun,  Eugene  Davis,  and  Michael  Deale. 

Scheduling  and  Rescheduling  With  Iterative  Repair. 

Intelligent  Scheduling. 

In  Mark  Fox  and  Monte  Zweben, 

Morgan  Kaufmann  Publishers,  1994,  pages  241-255,  Chapter  8. 


